Feb 27 01:58:39 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:58:39 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:58:39 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:58:39 devstack cinder-volume[73435]: INFO dbcounter [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Registered counter for database cinder Feb 27 01:58:39 devstack cinder-volume[73435]: DEBUG oslo_db.sqlalchemy.engines [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG dbcounter [-] [73435] Writer thread running {{(pid=73435) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.rpc [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.rpc [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_db.sqlalchemy.engines [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.volume.manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Determined volume DB was empty at startup. Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG cinder.volume.manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73435) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.volume.manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING stevedore.named [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING castellan.key_manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING cinder.keymgr.conf_key_mgr [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG cinder.volume.drivers.lvm [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73435) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_concurrency.processutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73435) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_concurrency.processutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.267s {{(pid=73435) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_db.sqlalchemy.engines [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.rpc [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.rpc [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING stevedore.named [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING castellan.key_manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:58:40 devstack cinder-volume[73435]: INFO cinder.volume.manager [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_db.sqlalchemy.engines [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:58:40 devstack cinder-volume[73435]: INFO oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Starting 1 workers Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Started child 73535 {{(pid=73435) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Full set of CONF: {{(pid=73435) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] ******************************************************************************** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Configuration options gathered from: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 01:58:40 devstack cinder-volume[73535]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] ================================================================================ {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] allow_availability_zone_fallback = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] allow_compression_on_image_upload = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] allowed_direct_url_schemes = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] api_rate_limit = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] auth_strategy = keystone {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] az_cache_duration = 3600 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_availability_zone = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_host = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_stats_polling_interval = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backup_api_class = cinder.backup.api.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backup_name_template = backup-%s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backup_use_same_host = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backup_use_temp_snapshot = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] chap_password = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] chap_username = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_internal_tenant_project_id = bca015b5303f4f52b8dcb136ca9ce0e5 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_internal_tenant_user_id = 01df54c940f8478b92e1696966339f88 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cloned_volume_same_az = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cluster = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] compression_format = gzip {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] compute_api_class = cinder.compute.nova.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] config_dir = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] config_source = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] control_exchange = openstack {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] debug = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] default_availability_zone = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] default_group_type = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] default_volume_type = lvmdriver-1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] disk_geometry = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_client_cert = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_client_cert_key = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_data_namespace = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_ssl_cert_path = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_ssl_cert_verify = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] driver_use_ssl = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] enable_force_upload = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] enable_new_services = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] enable_unsupported_driver = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] enforce_multipath_for_image_xfer = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] filter_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_api_insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_api_ssl_compression = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_ca_certificates_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_catalog_info = image:glance:publicURL {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_num_retries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance_request_timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] goodness_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] graceful_shutdown_timeout = 5 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] group_api_class = cinder.group.api.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] host = devstack {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_compress_on_upload = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_conversion_address_space_limit = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_conversion_cpu_limit = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_conversion_disable = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_upload_use_cinder_backend = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_upload_use_internal_tenant = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_volume_cache_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_volume_cache_max_count = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] image_volume_cache_max_size_gb = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] init_host_max_objects_retrieval = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] instance_format = [instance: %(uuid)s] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iscsi_target_flags = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iscsi_write_cache = on {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iser_helper = tgtadm {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iser_ip_address = 192.168.122.141 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73535]: INFO cinder.volume.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iser_port = 3260 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_color = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_config_append = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_dir = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_options = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_rotate_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_rotate_interval_type = days {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] log_rotation_type = none {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] max_age = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] max_logfile_count = 30 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] max_logfile_size_mb = 200 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] max_over_subscription_ratio = 20.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] message_reap_interval = 86400 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] message_ttl = 2592000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] migration_create_volume_timeout_secs = 300 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] monkey_patch = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] monkey_patch_modules = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] my_ip = 192.168.122.141 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] no_snapshot_gb_quota = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] num_iser_scan_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] num_shell_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] num_volume_device_scan_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] nvmeof_conn_info_version = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] nvmet_ns_id = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] nvmet_port_id = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_max_limit = 1000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_ext_list = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_listen_port = 8776 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_use_ssl = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] osapi_volume_workers = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] per_volume_size_limit = -1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] periodic_fuzzy_delay = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] periodic_interval = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] public_endpoint = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] publish_errors = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_backup_gigabytes = 1000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_backups = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_gigabytes = 1000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_groups = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_snapshots = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] quota_volumes = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] rate_limit_burst = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] rate_limit_except_level = CRITICAL {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] rate_limit_interval = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] reinit_driver_count = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] replication_device = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] report_discard_supported = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] report_interval = 120 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] reservation_clean_interval = 86400 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] reservation_expire = 86400 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] reserved_image_namespaces = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] reserved_percentage = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] rpc_response_timeout = 120 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] run_external_periodic_tasks = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] scst_target_driver = iscsi {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] scst_target_iqn_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_down_time = 720 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] shell_completion = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] snapshot_name_template = snapshot-%s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] snapshot_same_host = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] split_loggers = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] state_path = /opt/stack/data/cinder {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] storage_availability_zone = nova {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] storage_protocol = iSCSI {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] syslog_log_facility = LOG_USER {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_helper = lioadm {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_ip_address = 192.168.122.141 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_port = 3260 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_protocol = iscsi {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] target_secondary_ip_addresses = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] trace_flags = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] transport_url = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] until_refresh = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_chap_auth = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_default_quota_class = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_journal = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_json = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_multipath_for_image_xfer = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_stderr = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] use_syslog = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] verify_glance_signatures = enabled {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_api_class = cinder.volume.api.API {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_backend_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_clear = zero {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_clear_ionice = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_clear_size = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_copy_bps_limit = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_dd_blocksize = 1M {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_name_template = volume-%s {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_service_inithost_offload = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volume_usage_audit_period = month {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] zoning_mode = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_concurrency.disable_process_locking = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.admin_password = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.admin_token = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.admin_user = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_port = 35357 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_protocol = https {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_section = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_type = password {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_uri = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.auth_version = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.cache = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.identity_uri = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.include_service_catalog = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.interface = public {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_password = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcache_username = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.region_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.service_type = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.backend = dogpile.cache.null {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.backend_argument = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.backend_expiration_time = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.config_prefix = cache.oslo {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.debug_cache_backend = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.enable_retry_client = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.enable_socket_keepalive = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.enforce_fips_mode = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.expiration_time = 600 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.hashclient_retry_attempts = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_dead_retry = 300 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_pool_maxsize = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_sasl_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.password = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.proxies = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.redis_db = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.redis_server = localhost:6379 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.retry_attempts = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.retry_delay = 0.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.socket_keepalive_count = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.socket_keepalive_idle = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.socket_keepalive_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.socket_timeout = 1.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.tls_allowed_ciphers = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.tls_cafile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.tls_certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.tls_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.tls_keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cache.username = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] coordination.backend_url = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.asyncio_connection = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.asyncio_slave_connection = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.backend = sqlalchemy {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.connection = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.connection_debug = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.connection_parameters = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.connection_recycle_time = 3600 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.connection_trace = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.db_inc_retry_interval = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.db_max_retries = 20 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.db_max_retry_interval = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.db_retry_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.max_overflow = 50 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.max_pool_size = 5 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.max_retries = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.mysql_wsrep_sync_wait = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.pool_timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.retry_interval = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.slave_connection = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.sqlite_synchronous = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.synchronous_reader = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] database.use_db_reconnect = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.connection_string = messaging:// {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.es_doc_type = notification {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.es_scroll_size = 10000 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.es_scroll_time = 2m {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.filter_error_trace = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.hmac_keys = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.sentinel_service_name = mymaster {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.socket_timeout = 0.1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.trace_requests = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler.trace_sqlalchemy = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler_jaeger.process_tags = {} {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler_jaeger.service_name_prefix = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] profiler_otlp.service_name_prefix = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.enforce_new_defaults = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: WARNING oslo_config.cfg [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.enforce_scope = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.policy_default_rule = default {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:40 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.policy_file = policy.yaml {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.group = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.helper_command = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] privsep_osbrick.user = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.group = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.helper_command = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] cinder_sys_admin.user = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.auth_section = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.auth_type = password {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.cafile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.collect_timing = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.send_service_user_token = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.split_loggers = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] service_user.timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.auth_section = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.auth_type = password {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.collect_timing = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.region_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.split_loggers = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] glance.timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.backend_availability_zone = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.chap_password = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.chap_username = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.disk_geometry = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_client_cert = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_client_cert_key = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_data_namespace = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.driver_use_ssl = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.extra_capabilities = {} {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.filter_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.goodness_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iscsi_target_flags = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iscsi_write_cache = on {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iser_helper = tgtadm {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iser_port = 3260 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.lvm_share_target = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.lvm_type = auto {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.num_shell_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.replication_device = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.report_discard_supported = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.reserved_percentage = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_helper = tgtadm {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_port = 3260 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_protocol = iscsi {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.trace_flags = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.unique_fqdn_network = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.use_chap_auth = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_backend_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_clear = zero {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_clear_ionice = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_clear_size = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_reports.file_event_handler = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_reports.log_dir = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.backend_host = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.chap_password = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.chap_username = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.disk_geometry = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_client_cert = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.extra_capabilities = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.filter_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.goodness_function = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iser_helper = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iser_ip_address = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iser_port = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.lvm_share_target = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.lvm_type = auto {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.num_shell_tries = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.replication_device = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.report_discard_supported = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.reserved_percentage = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.scst_target_driver = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.storage_protocol = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_helper = lioadm {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_ip_address = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_port = 3260 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.trace_flags = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.use_chap_auth = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_clear = zero {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_clear_size = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack sudo[73539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] lvmdriver-1.volumes_dir = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack sudo[73539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_notifications.driver = [] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_notifications.retry = -1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] key_manager.fixed_key = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.barbican_api_version = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.barbican_endpoint = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.barbican_endpoint_type = public {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.barbican_region_name = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.cafile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.collect_timing = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.number_of_retries = 60 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.retry_delay = 1 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.send_service_user_token = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.split_loggers = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.verify_ssl = True {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican.verify_ssl_path = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.auth_section = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.auth_type = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.cafile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.certfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.collect_timing = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.insecure = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.keyfile = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.split_loggers = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] barbican_service_user.timeout = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.approle_role_id = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.approle_secret_id = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.kv_mountpoint = secret {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.kv_path = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.kv_version = 2 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.namespace = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.root_token_id = **** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.ssl_ca_crt_file = None {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.timeout = 60.0 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.use_ssl = False {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:58:40 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] ******************************************************************************** {{(pid=73435) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 01:58:41 devstack sudo[73539]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.565s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:41 devstack sudo[73709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:41 devstack sudo[73709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:41 devstack sudo[73709]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.557s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 01:58:41 devstack cinder-volume[73535]: INFO cinder.brick.local_dev.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:41 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:41 devstack sudo[73947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:41 devstack sudo[73947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:42 devstack sudo[73947]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:42 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:42 devstack cinder-volume[73535]: DEBUG cinder.brick.local_dev.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73535) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 01:58:42 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:42 devstack sudo[74060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:42 devstack sudo[74060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:43 devstack sudo[74060]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.771s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:43 devstack sudo[74213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:43 devstack sudo[74213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:43 devstack sudo[74213]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:43 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:43 devstack sudo[74224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 01:58:43 devstack sudo[74224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:44 devstack sudo[74224]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:44 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.424s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:44 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:44 devstack sudo[74227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:44 devstack sudo[74227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:44 devstack sudo[74227]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:44 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:44 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:44 devstack sudo[74232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:44 devstack sudo[74232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:45 devstack sudo[74232]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:45 devstack sudo[74236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:45 devstack sudo[74236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:45 devstack sudo[74236]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:45 devstack sudo[74244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:45 devstack sudo[74244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:45 devstack sudo[74244]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:45 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:46 devstack sudo[74249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:46 devstack sudo[74249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:46 devstack sudo[74249]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.588s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:46 devstack cinder-volume[73535]: INFO cinder.volume.drivers.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:46 devstack sudo[74314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:46 devstack sudo[74314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:47 devstack sudo[74314]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:47 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:47 devstack sudo[74371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:47 devstack sudo[74371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:47 devstack sudo[74371]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:47 devstack sudo[74513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:47 devstack sudo[74513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:48 devstack sudo[74513]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:48 devstack sudo[74516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:48 devstack sudo[74516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:48 devstack sudo[74516]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:48 devstack sudo[74519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:48 devstack sudo[74519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:48 devstack sudo[74519]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:48 devstack cinder-volume[73535]: INFO cinder.volume.driver [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG cinder.volume.driver [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73535) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG oslo_db.sqlalchemy.engines [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:58:48 devstack cinder-volume[73535]: DEBUG dbcounter [-] [73535] Writer thread running {{(pid=73535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG cinder.db.sqlalchemy.api [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Building query based on filter {{(pid=73535) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG cinder.image.image_utils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73535) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 01:58:49 devstack cinder-volume[73535]: INFO cinder.keymgr.migration [None req-8a13b98f-9491-4692-816b-cd3b0c6b1969 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[74524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[74524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:49 devstack sudo[74524]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[74530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[74530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:49 devstack sudo[74530]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:49 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:50 devstack sudo[74535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:50 devstack sudo[74535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[74535]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:50 devstack sudo[74538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:50 devstack sudo[74538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack cinder-volume[73435]: DEBUG dbcounter [-] [73435] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73435) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:51 devstack sudo[74538]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.563s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG cinder.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Notifying Schedulers of capabilities ... {{(pid=73535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:58:51 devstack cinder-volume[73535]: INFO cinder.volume.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Driver initialization completed successfully. Feb 27 01:58:51 devstack cinder-volume[73535]: INFO cinder.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Initiating service 2 cleanup Feb 27 01:58:51 devstack cinder-volume[73535]: INFO cinder.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Service 2 cleanup completed. Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG cinder.service [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Creating RPC server for service cinder-volume {{(pid=73535) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG cinder.service [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73535) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 01:58:51 devstack cinder-volume[73535]: INFO cinder.volume.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:51 devstack sudo[74544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:51 devstack sudo[74544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:51 devstack sudo[74544]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:51 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:51 devstack sudo[74604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:51 devstack sudo[74604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:52 devstack sudo[74604]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:52 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:52 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:52 devstack sudo[74607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:52 devstack sudo[74607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:52 devstack sudo[74607]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:52 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:52 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:52 devstack sudo[74610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:52 devstack sudo[74610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:52 devstack sudo[74610]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:52 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:52 devstack cinder-volume[73535]: INFO cinder.volume.manager [None req-c92d2d75-a4e2-4e3f-92c7-52237dbaa357 None None] Driver post RPC initialization completed successfully. Feb 27 01:59:01 devstack cinder-volume[73535]: DEBUG dbcounter [-] [73535] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:59:02 devstack cinder-volume[73535]: DEBUG dbcounter [-] [73535] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:59:46 devstack cinder-volume[73535]: DEBUG oslo_service.periodic_task [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73535) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:59:46 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:59:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:46 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:59:46 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:47 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:47 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:47 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:47 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:47 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:59:47 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:48 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:48 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:48 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:48 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:48 devstack cinder-volume[73535]: DEBUG cinder.manager [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Notifying Schedulers of capabilities ... {{(pid=73535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:46 devstack cinder-volume[73535]: DEBUG oslo_service.periodic_task [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73535) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:00:46 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 02:00:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:46 devstack sudo[79818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 02:00:46 devstack sudo[79818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:47 devstack sudo[79818]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:47 devstack sudo[79822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:47 devstack sudo[79822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:47 devstack sudo[79822]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:47 devstack sudo[79826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 02:00:47 devstack sudo[79826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:48 devstack sudo[79826]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:48 devstack sudo[79831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:00:48 devstack sudo[79831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:48 devstack sudo[79831]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:48 devstack cinder-volume[73535]: DEBUG cinder.manager [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Notifying Schedulers of capabilities ... {{(pid=73535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:02 devstack cinder-volume[73535]: DEBUG dbcounter [-] [73535] Writing DB stats cinder:SELECT=1 {{(pid=73535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:02 devstack cinder-volume[73535]: DEBUG dbcounter [-] [73535] Writing DB stats cinder:UPDATE=1 {{(pid=73535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:46 devstack cinder-volume[73535]: DEBUG oslo_service.periodic_task [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73535) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:01:46 devstack cinder-volume[73535]: DEBUG cinder.volume.drivers.lvm [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Updating volume stats {{(pid=73535) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 02:01:46 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:46 devstack sudo[81761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 02:01:46 devstack sudo[81761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[81761]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:47 devstack sudo[81788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:01:47 devstack sudo[81788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[81788]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:47 devstack sudo[81794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 02:01:47 devstack sudo[81794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:48 devstack sudo[81794]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:48 devstack sudo[81797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 02:01:48 devstack sudo[81797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:48 devstack sudo[81797]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:48 devstack cinder-volume[73535]: DEBUG oslo_concurrency.processutils [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73535) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:48 devstack cinder-volume[73535]: DEBUG cinder.manager [None req-6543740f-9c72-45cf-9c6b-6deee19bcb88 None None] Notifying Schedulers of capabilities ... {{(pid=73535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:35 devstack cinder-volume[73435]: INFO oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Caught SIGTERM, stopping children Feb 27 02:02:35 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Acquiring lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:35 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Acquired lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:35 devstack cinder-volume[73435]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Releasing lock "singleton_lock" {{(pid=73435) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:35 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Stop services. {{(pid=73435) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:02:35 devstack cinder-volume[73435]: DEBUG oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Killing children. {{(pid=73435) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:02:35 devstack cinder-volume[73435]: INFO oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Waiting on 1 children to exit Feb 27 02:02:36 devstack cinder-volume[73535]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Acquiring lock "singleton_lock" {{(pid=73535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:36 devstack cinder-volume[73535]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Acquired lock "singleton_lock" {{(pid=73535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:36 devstack cinder-volume[73535]: DEBUG oslo_concurrency.lockutils [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Releasing lock "singleton_lock" {{(pid=73535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:36 devstack cinder-volume[73535]: WARNING amqp [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:02:36 devstack cinder-volume[73535]: WARNING amqp [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:02:36 devstack cinder-volume[73435]: INFO oslo_service.backend._eventlet.service [None req-97e4e0aa-01fb-454a-81de-784d21840ad2 None None] Child 73535 exited with status 0 Feb 27 02:02:38 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:38 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:38 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:39 devstack cinder-volume[82746]: INFO dbcounter [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Registered counter for database cinder Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_db.sqlalchemy.engines [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG dbcounter [-] [82746] Writer thread running {{(pid=82746) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:02:39 devstack cinder-volume[82746]: INFO cinder.rpc [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:02:39 devstack cinder-volume[82746]: INFO cinder.rpc [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_db.sqlalchemy.engines [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:39 devstack cinder-volume[82746]: INFO cinder.volume.manager [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Determined volume DB was empty at startup. Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG cinder.volume.manager [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82746) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:02:39 devstack cinder-volume[82746]: INFO cinder.volume.manager [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 02:02:39 devstack cinder-volume[82746]: WARNING stevedore.named [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:02:39 devstack cinder-volume[82746]: WARNING castellan.key_manager [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:02:39 devstack cinder-volume[82746]: WARNING cinder.keymgr.conf_key_mgr [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:02:39 devstack cinder-volume[82746]: INFO cinder.volume.manager [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_db.sqlalchemy.engines [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:39 devstack cinder-volume[82746]: INFO oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Starting 1 workers Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Started child 82863 {{(pid=82746) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Full set of CONF: {{(pid=82746) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] ******************************************************************************** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Configuration options gathered from: {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] ================================================================================ {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] allow_availability_zone_fallback = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] allow_compression_on_image_upload = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] allowed_direct_url_schemes = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] api_rate_limit = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] auth_strategy = keystone {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_availability_zone = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_host = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_stats_polling_interval = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backup_api_class = cinder.backup.api.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backup_name_template = backup-%s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backup_use_same_host = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backup_use_temp_snapshot = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] chap_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] chap_username = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_internal_tenant_project_id = bca015b5303f4f52b8dcb136ca9ce0e5 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_internal_tenant_user_id = 01df54c940f8478b92e1696966339f88 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cluster = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] compression_format = gzip {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] compute_api_class = cinder.compute.nova.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] config_dir = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] config_source = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] control_exchange = openstack {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82863]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] debug = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] default_availability_zone = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] default_group_type = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] default_volume_type = QuobyteHD {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] disk_geometry = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_client_cert = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_client_cert_key = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_data_namespace = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_ssl_cert_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_ssl_cert_verify = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] driver_use_ssl = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] enable_new_services = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] enable_unsupported_driver = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] enabled_backends = ['QuobyteHD'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] enforce_multipath_for_image_xfer = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] filter_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_api_insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_api_ssl_compression = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_ca_certificates_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_catalog_info = image:glance:publicURL {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_num_retries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance_request_timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] goodness_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] graceful_shutdown_timeout = 5 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] group_api_class = cinder.group.api.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] host = devstack {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_compress_on_upload = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_conversion_address_space_limit = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_conversion_cpu_limit = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_conversion_disable = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_upload_use_cinder_backend = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_upload_use_internal_tenant = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_volume_cache_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_volume_cache_max_count = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] image_volume_cache_max_size_gb = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] init_host_max_objects_retrieval = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] instance_format = [instance: %(uuid)s] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iscsi_target_flags = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iscsi_write_cache = on {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iser_helper = tgtadm {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iser_ip_address = 192.168.122.141 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iser_port = 3260 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_color = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_config_append = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_dir = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_options = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_rotate_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_rotate_interval_type = days {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] log_rotation_type = none {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] max_age = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] max_logfile_count = 30 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] max_logfile_size_mb = 200 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] max_over_subscription_ratio = 20.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] message_reap_interval = 86400 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] message_ttl = 2592000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] migration_create_volume_timeout_secs = 300 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] monkey_patch = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] monkey_patch_modules = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] my_ip = 192.168.122.141 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] no_snapshot_gb_quota = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] num_iser_scan_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] num_shell_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] num_volume_device_scan_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] nvmeof_conn_info_version = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] nvmet_ns_id = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] nvmet_port_id = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_max_limit = 1000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_ext_list = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_listen = 0.0.0.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_listen_port = 8776 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_use_ssl = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] osapi_volume_workers = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] per_volume_size_limit = -1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] periodic_fuzzy_delay = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] periodic_interval = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] project_id_regex = [0-9a-f\-]+ {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] public_endpoint = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] publish_errors = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_backup_gigabytes = 1000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_backups = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_gigabytes = 1000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_groups = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_snapshots = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] quota_volumes = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] rate_limit_burst = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] rate_limit_except_level = CRITICAL {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] rate_limit_interval = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] reinit_driver_count = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] replication_device = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] report_discard_supported = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] report_interval = 120 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] reservation_clean_interval = 86400 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] reservation_expire = 86400 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] reserved_image_namespaces = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] reserved_percentage = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] rpc_response_timeout = 120 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] run_external_periodic_tasks = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] scst_target_driver = iscsi {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] scst_target_iqn_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_down_time = 720 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] shell_completion = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] snapshot_name_template = snapshot-%s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] split_loggers = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] state_path = /opt/stack/data/cinder {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] storage_availability_zone = nova {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] storage_protocol = iSCSI {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] syslog_log_facility = LOG_USER {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_helper = lioadm {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_ip_address = 192.168.122.141 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_port = 3260 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_protocol = iscsi {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] target_secondary_ip_addresses = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] trace_flags = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] transfer_api_class = cinder.transfer.api.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] transport_url = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] until_refresh = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_chap_auth = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_default_quota_class = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_journal = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_json = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_multipath_for_image_xfer = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_stderr = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] use_syslog = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] verify_glance_signatures = enabled {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_api_class = cinder.volume.api.API {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_backend_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_clear = zero {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_clear_ionice = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_clear_size = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_copy_bps_limit = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_dd_blocksize = 1M {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_name_template = volume-%s {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_service_inithost_offload = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volume_usage_audit_period = month {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] zoning_mode = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_concurrency.disable_process_locking = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.admin_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.admin_token = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.admin_user = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_admin_prefix = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_port = 35357 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_protocol = https {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_section = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_type = password {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_uri = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.auth_version = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.cache = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.identity_uri = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.include_service_catalog = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.interface = public {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_password = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcache_username = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.region_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.service_type = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.backend = dogpile.cache.null {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.backend_argument = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.backend_expiration_time = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.config_prefix = cache.oslo {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.debug_cache_backend = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.enable_retry_client = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.enable_socket_keepalive = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.enforce_fips_mode = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.expiration_time = 600 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.hashclient_retry_attempts = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_dead_retry = 300 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_pool_maxsize = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_sasl_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.proxies = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.redis_db = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.redis_server = localhost:6379 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.retry_attempts = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.retry_delay = 0.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.socket_keepalive_count = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.socket_keepalive_idle = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.socket_keepalive_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.socket_timeout = 1.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.tls_allowed_ciphers = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.tls_cafile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.tls_certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.tls_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.tls_keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cache.username = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] coordination.backend_url = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.asyncio_connection = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.asyncio_slave_connection = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.backend = sqlalchemy {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.connection = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.connection_debug = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.connection_parameters = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.connection_recycle_time = 3600 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.connection_trace = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.db_inc_retry_interval = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.db_max_retries = 20 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.db_max_retry_interval = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.db_retry_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.max_overflow = 50 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.max_pool_size = 5 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.max_retries = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.mysql_wsrep_sync_wait = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.pool_timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.retry_interval = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.slave_connection = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.sqlite_synchronous = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.synchronous_reader = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] database.use_db_reconnect = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.connection_string = messaging:// {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.es_doc_type = notification {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.es_scroll_size = 10000 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.es_scroll_time = 2m {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.filter_error_trace = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.hmac_keys = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.sentinel_service_name = mymaster {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.socket_timeout = 0.1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.trace_requests = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler.trace_sqlalchemy = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler_jaeger.process_tags = {} {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler_jaeger.service_name_prefix = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] profiler_otlp.service_name_prefix = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.enforce_new_defaults = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: WARNING oslo_config.cfg [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.enforce_scope = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.policy_default_rule = default {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.policy_file = policy.yaml {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_policy.remote_timeout = 60.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.group = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.helper_command = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] privsep_osbrick.user = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.group = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.helper_command = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] cinder_sys_admin.user = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.auth_section = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.auth_type = password {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.cafile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.collect_timing = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.send_service_user_token = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.split_loggers = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] service_user.timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.auth_section = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.auth_type = password {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.collect_timing = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.region_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.split_loggers = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] glance.timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.backend_availability_zone = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.chap_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.chap_username = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.disk_geometry = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_client_cert = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_client_cert_key = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_data_namespace = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.driver_use_ssl = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.extra_capabilities = {} {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.filter_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.goodness_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iscsi_target_flags = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iscsi_write_cache = on {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iser_helper = tgtadm {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iser_port = 3260 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_host = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_login = admin {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_mount_options = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_private_key = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_share_path = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_ssh_port = 22 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.num_shell_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.quobyte_volume_url = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.replication_device = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.report_discard_supported = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.reserved_percentage = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_helper = tgtadm {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_port = 3260 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_protocol = iscsi {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.trace_flags = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.unique_fqdn_network = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.use_chap_auth = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_backend_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_clear = zero {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_clear_ionice = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_clear_size = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:39 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_reports.file_event_handler = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_reports.log_dir = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.backend_availability_zone = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.backend_host = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.chap_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.chap_username = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.chiscsi_conf = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.disk_geometry = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_client_cert = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_data_namespace = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.driver_use_ssl = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.extra_capabilities = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.filter_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.goodness_function = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iscsi_target_flags = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iscsi_write_cache = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iser_helper = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iser_ip_address = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iser_port = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.iser_target_prefix = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_host = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_login = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_mount_options = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_password = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_private_key = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_share_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_ssh_port = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.num_shell_tries = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nvmet_ns_id = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.nvmet_port_id = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.replication_device = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.report_discard_supported = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.reserved_percentage = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.scst_target_driver = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.storage_protocol = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_helper = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_ip_address = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_port = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_prefix = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_protocol = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.trace_flags = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.unique_fqdn_network = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.use_chap_auth = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_clear = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_clear_ionice = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_clear_size = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] QuobyteHD.volumes_dir = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.ssl_version = {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_notifications.driver = [] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_notifications.retry = -1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] key_manager.fixed_key = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.barbican_api_version = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.barbican_endpoint = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.barbican_endpoint_type = public {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.barbican_region_name = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.cafile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.collect_timing = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.number_of_retries = 60 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.retry_delay = 1 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.send_service_user_token = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.split_loggers = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.verify_ssl = True {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican.verify_ssl_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.auth_section = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.auth_type = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.cafile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.certfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.collect_timing = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.insecure = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.keyfile = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.split_loggers = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] barbican_service_user.timeout = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.approle_role_id = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.approle_secret_id = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.kv_mountpoint = secret {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.kv_path = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.kv_version = 2 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.namespace = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.root_token_id = **** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.ssl_ca_crt_file = None {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.timeout = 60.0 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.use_ssl = False {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:40 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] ******************************************************************************** {{(pid=82746) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:02:40 devstack cinder-volume[82863]: WARNING cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:02:40 devstack cinder-volume[82863]: WARNING cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Running cmd (subprocess): mount.quobyte {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack quobyte-client[82864]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:02:40 devstack quobyte-client[82864]: Invalid parameters found, error: missing mount point. Feb 27 02:02:40 devstack quobyte-client[82864]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:02:40 devstack quobyte-client[82864]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 ... Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 -c /etc/quobyte/client-cinder.cfg {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack sudo[82865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 -c /etc/quobyte/client-cinder.cfg Feb 27 02:02:40 devstack sudo[82865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:40 devstack sudo[82865]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.666s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 succeeded Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.680s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack sudo[82934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:40 devstack sudo[82934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:41 devstack sudo[82934]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.493s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:41 devstack cinder-volume[82863]: INFO cinder.volume.driver [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.volume.driver [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7397422790527, 'free_capacity_gb': 1775.7397422790527, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_db.sqlalchemy.engines [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writer thread running {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.db.sqlalchemy.api [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Building query based on filter {{(pid=82863) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:02:41 devstack cinder-volume[82863]: INFO cinder.keymgr.migration [None req-63b72a26-0919-4298-aac4-ca42636b6b2e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:41 devstack sudo[82939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:41 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:41 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.466s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Driver initialization completed successfully. Feb 27 02:02:41 devstack cinder-volume[82863]: INFO cinder.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Initiating service 3 cleanup Feb 27 02:02:41 devstack cinder-volume[82863]: INFO cinder.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Service 3 cleanup completed. Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.service [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Creating RPC server for service cinder-volume {{(pid=82863) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:02:41 devstack cinder-volume[82863]: DEBUG cinder.service [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82863) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:02:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:42 devstack sudo[82944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:42 devstack sudo[82944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:42 devstack sudo[82944]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.532s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2efebc8-3b0e-447c-afa4-fe78911cf1f5 None None] Driver post RPC initialization completed successfully. Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:45 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:45 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:46 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.450s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:46 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d700b20e-8bdd-4188-8433-2068050e9b97 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:49 devstack cinder-volume[82746]: INFO oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Caught SIGTERM, stopping children Feb 27 02:02:49 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Acquiring lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:49 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Acquired lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:49 devstack cinder-volume[82746]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Releasing lock "singleton_lock" {{(pid=82746) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:49 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Stop services. {{(pid=82746) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:02:49 devstack cinder-volume[82746]: DEBUG oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Killing children. {{(pid=82746) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:02:49 devstack cinder-volume[82746]: INFO oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Waiting on 1 children to exit Feb 27 02:02:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Acquiring lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Acquired lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Releasing lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:50 devstack cinder-volume[82863]: WARNING amqp [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:02:50 devstack cinder-volume[82863]: WARNING amqp [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:02:50 devstack cinder-volume[82746]: INFO oslo_service.backend._eventlet.service [None req-15c19e4f-34de-431a-87c0-cfff12eaa21e None None] Child 82863 exited with status 0 Feb 27 02:02:52 devstack cinder-volume[83076]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:02:52 devstack cinder-volume[83076]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:02:52 devstack cinder-volume[83076]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:02:53 devstack cinder-volume[83076]: INFO dbcounter [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Registered counter for database cinder Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_db.sqlalchemy.engines [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG dbcounter [-] [83076] Writer thread running {{(pid=83076) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:02:53 devstack cinder-volume[83076]: INFO cinder.rpc [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:02:53 devstack cinder-volume[83076]: INFO cinder.rpc [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_db.sqlalchemy.engines [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:53 devstack cinder-volume[83076]: INFO cinder.volume.manager [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Determined volume DB was empty at startup. Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG cinder.volume.manager [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83076) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:02:53 devstack cinder-volume[83076]: WARNING stevedore.named [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:02:53 devstack cinder-volume[83076]: WARNING castellan.key_manager [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:02:53 devstack cinder-volume[83076]: WARNING cinder.keymgr.conf_key_mgr [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:02:53 devstack cinder-volume[83076]: INFO cinder.volume.manager [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_db.sqlalchemy.engines [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:53 devstack cinder-volume[83076]: INFO oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Starting 1 workers Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Started child 83211 {{(pid=83076) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Full set of CONF: {{(pid=83076) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] ******************************************************************************** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Configuration options gathered from: {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] ================================================================================ {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] allow_availability_zone_fallback = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] allow_compression_on_image_upload = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] allowed_direct_url_schemes = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] api_rate_limit = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] auth_strategy = keystone {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_availability_zone = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_host = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_stats_polling_interval = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backup_api_class = cinder.backup.api.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backup_name_template = backup-%s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backup_use_same_host = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backup_use_temp_snapshot = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] chap_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] chap_username = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_internal_tenant_project_id = bca015b5303f4f52b8dcb136ca9ce0e5 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_internal_tenant_user_id = 01df54c940f8478b92e1696966339f88 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cluster = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] compression_format = gzip {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] compute_api_class = cinder.compute.nova.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] config_dir = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] config_source = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] control_exchange = openstack {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83211]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] debug = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] default_availability_zone = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] default_group_type = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] default_volume_type = QuobyteHD {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] disk_geometry = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_client_cert = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_client_cert_key = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_data_namespace = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_ssl_cert_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_ssl_cert_verify = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] driver_use_ssl = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] enable_new_services = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] enable_unsupported_driver = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] enabled_backends = ['QuobyteHD'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] enforce_multipath_for_image_xfer = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] filter_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_api_insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_api_ssl_compression = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_ca_certificates_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_catalog_info = image:glance:publicURL {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_num_retries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance_request_timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] goodness_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] graceful_shutdown_timeout = 5 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] group_api_class = cinder.group.api.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] host = devstack {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_compress_on_upload = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_conversion_address_space_limit = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_conversion_cpu_limit = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_conversion_disable = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_upload_use_cinder_backend = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_upload_use_internal_tenant = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_volume_cache_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_volume_cache_max_count = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] image_volume_cache_max_size_gb = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] init_host_max_objects_retrieval = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] instance_format = [instance: %(uuid)s] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iscsi_target_flags = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iscsi_write_cache = on {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iser_helper = tgtadm {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iser_ip_address = 192.168.122.141 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iser_port = 3260 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_color = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_config_append = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_dir = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_options = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_rotate_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_rotate_interval_type = days {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] log_rotation_type = none {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] max_age = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] max_logfile_count = 30 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] max_logfile_size_mb = 200 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] max_over_subscription_ratio = 20.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] message_reap_interval = 86400 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] message_ttl = 2592000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] migration_create_volume_timeout_secs = 300 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] monkey_patch = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] monkey_patch_modules = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] my_ip = 192.168.122.141 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] no_snapshot_gb_quota = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] num_iser_scan_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] num_shell_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] num_volume_device_scan_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] nvmeof_conn_info_version = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] nvmet_ns_id = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] nvmet_port_id = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_max_limit = 1000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_ext_list = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_listen_port = 8776 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_use_ssl = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] osapi_volume_workers = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] per_volume_size_limit = -1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] periodic_fuzzy_delay = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] periodic_interval = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] public_endpoint = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] publish_errors = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_backup_gigabytes = 1000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_backups = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_gigabytes = 1000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_groups = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_snapshots = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] quota_volumes = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] rate_limit_burst = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] rate_limit_except_level = CRITICAL {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] rate_limit_interval = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] reinit_driver_count = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] replication_device = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] report_discard_supported = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83211) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] report_interval = 120 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] reservation_clean_interval = 86400 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] reservation_expire = 86400 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] reserved_image_namespaces = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] reserved_percentage = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] rpc_response_timeout = 120 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] run_external_periodic_tasks = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] scst_target_driver = iscsi {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] scst_target_iqn_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_down_time = 720 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] shell_completion = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] snapshot_name_template = snapshot-%s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] split_loggers = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] state_path = /opt/stack/data/cinder {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] storage_availability_zone = nova {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] storage_protocol = iSCSI {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] syslog_log_facility = LOG_USER {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_helper = lioadm {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_ip_address = 192.168.122.141 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_port = 3260 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_protocol = iscsi {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] target_secondary_ip_addresses = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] trace_flags = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] transport_url = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] until_refresh = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_chap_auth = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_default_quota_class = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_journal = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_json = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_multipath_for_image_xfer = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_stderr = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] use_syslog = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] verify_glance_signatures = enabled {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_api_class = cinder.volume.api.API {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_backend_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_clear = zero {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_clear_ionice = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_clear_size = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_copy_bps_limit = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_dd_blocksize = 1M {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_name_template = volume-%s {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_service_inithost_offload = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volume_usage_audit_period = month {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] zoning_mode = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_concurrency.disable_process_locking = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.admin_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.admin_token = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.admin_user = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_port = 35357 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_protocol = https {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_section = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_type = password {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_uri = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.auth_version = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.cache = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.identity_uri = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.include_service_catalog = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.interface = public {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_password = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcache_username = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.region_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.service_type = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.backend = dogpile.cache.null {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.backend_argument = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.backend_expiration_time = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.config_prefix = cache.oslo {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.debug_cache_backend = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.enable_retry_client = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.enable_socket_keepalive = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.enforce_fips_mode = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.expiration_time = 600 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.hashclient_retry_attempts = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_dead_retry = 300 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_pool_maxsize = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_sasl_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.proxies = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.redis_db = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.redis_server = localhost:6379 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.retry_attempts = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.retry_delay = 0.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.socket_keepalive_count = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.socket_keepalive_idle = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.socket_keepalive_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.socket_timeout = 1.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.tls_allowed_ciphers = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.tls_cafile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.tls_certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.tls_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.tls_keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cache.username = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] coordination.backend_url = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.asyncio_connection = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.asyncio_slave_connection = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.backend = sqlalchemy {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.connection = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.connection_debug = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.connection_parameters = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.connection_recycle_time = 3600 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.connection_trace = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.db_inc_retry_interval = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.db_max_retries = 20 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.db_max_retry_interval = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83211) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:02:53 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:02:53 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:02:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Running cmd (subprocess): mount.quobyte {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.db_retry_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.max_overflow = 50 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.max_pool_size = 5 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.max_retries = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.mysql_wsrep_sync_wait = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.pool_timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.retry_interval = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.slave_connection = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.sqlite_synchronous = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.synchronous_reader = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] database.use_db_reconnect = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.connection_string = messaging:// {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.es_doc_type = notification {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.es_scroll_size = 10000 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.es_scroll_time = 2m {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.filter_error_trace = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.hmac_keys = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.sentinel_service_name = mymaster {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.socket_timeout = 0.1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.trace_requests = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler.trace_sqlalchemy = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler_jaeger.process_tags = {} {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler_jaeger.service_name_prefix = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] profiler_otlp.service_name_prefix = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.enforce_new_defaults = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: WARNING oslo_config.cfg [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.enforce_scope = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.policy_default_rule = default {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.policy_file = policy.yaml {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.group = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.helper_command = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] privsep_osbrick.user = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.group = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.helper_command = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] cinder_sys_admin.user = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.auth_section = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.auth_type = password {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.cafile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.collect_timing = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.send_service_user_token = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.split_loggers = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] service_user.timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.auth_section = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.auth_type = password {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.collect_timing = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.region_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.split_loggers = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] glance.timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.backend_availability_zone = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:53 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.chap_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.chap_username = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.disk_geometry = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_client_cert = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_client_cert_key = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_data_namespace = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.driver_use_ssl = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.extra_capabilities = {} {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.filter_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.goodness_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iscsi_target_flags = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iscsi_write_cache = on {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iser_helper = tgtadm {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iser_port = 3260 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack quobyte-client[83214]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:02:54 devstack quobyte-client[83214]: Invalid parameters found, error: missing mount point. Feb 27 02:02:54 devstack quobyte-client[83214]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:02:54 devstack quobyte-client[83214]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_host = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_login = admin {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_mount_options = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_private_key = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_share_path = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.num_shell_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.quobyte_volume_url = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.replication_device = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.report_discard_supported = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.reserved_percentage = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_helper = tgtadm {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_port = 3260 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_protocol = iscsi {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.trace_flags = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.unique_fqdn_network = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.use_chap_auth = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_backend_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_clear = zero {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_clear_ionice = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_clear_size = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_reports.file_event_handler = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_reports.log_dir = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.backend_availability_zone = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.backend_host = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.chap_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.chap_username = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.chiscsi_conf = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.disk_geometry = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_client_cert = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_data_namespace = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.driver_use_ssl = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.extra_capabilities = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.filter_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.goodness_function = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iser_helper = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iser_ip_address = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iser_port = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.iser_target_prefix = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_host = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_login = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_mount_options = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_password = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_private_key = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_share_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_ssh_port = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack sudo[83216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.num_shell_tries = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack sudo[83216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.nvmet_port_id = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.replication_device = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.report_discard_supported = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.reserved_percentage = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.scst_target_driver = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.storage_protocol = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_helper = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_ip_address = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_port = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_prefix = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_protocol = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.trace_flags = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.use_chap_auth = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_clear = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_clear_size = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] QuobyteHD.volumes_dir = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_notifications.driver = [] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_notifications.retry = -1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] key_manager.fixed_key = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.barbican_api_version = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.barbican_endpoint = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.barbican_endpoint_type = public {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.barbican_region_name = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.cafile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.collect_timing = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.number_of_retries = 60 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.retry_delay = 1 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.send_service_user_token = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.split_loggers = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.verify_ssl = True {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican.verify_ssl_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.auth_section = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.auth_type = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.cafile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.certfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.collect_timing = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.insecure = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.keyfile = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.split_loggers = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] barbican_service_user.timeout = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.approle_role_id = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.approle_secret_id = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.kv_mountpoint = secret {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.kv_path = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.kv_version = 2 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.namespace = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.root_token_id = **** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.ssl_ca_crt_file = None {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.timeout = 60.0 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.use_ssl = False {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:02:54 devstack cinder-volume[83076]: DEBUG oslo_service.backend._eventlet.service [None req-17c7bbfd-dbd3-4019-af1f-9e9da67f2e31 None None] ******************************************************************************** {{(pid=83076) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:02:54 devstack sudo[83216]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.671s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:54 devstack cinder-volume[83211]: INFO cinder.volume.driver [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.volume.driver [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7397422790527, 'free_capacity_gb': 1775.7397422790527, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83211) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_db.sqlalchemy.engines [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writer thread running {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.db.sqlalchemy.api [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Building query based on filter {{(pid=83211) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83211) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:54 devstack cinder-volume[83211]: INFO cinder.keymgr.migration [None req-be2a17b6-e2ed-4fa4-b405-bdb653d321e0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:02:54 devstack sudo[83286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:54 devstack sudo[83286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:55 devstack sudo[83286]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Driver initialization completed successfully. Feb 27 02:02:55 devstack cinder-volume[83211]: INFO cinder.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Initiating service 3 cleanup Feb 27 02:02:55 devstack cinder-volume[83211]: INFO cinder.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Service 3 cleanup completed. Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.service [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Creating RPC server for service cinder-volume {{(pid=83211) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.service [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83211) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:02:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:55 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:55 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:55 devstack sudo[83333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:02:55 devstack sudo[83333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.827s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-023533d1-d39f-496d-a84c-b22e0d1b430c None None] Driver post RPC initialization completed successfully. Feb 27 02:02:56 devstack sudo[83333]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.843s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6bdcadaa-eceb-4cc6-a075-f48e568907ca None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:03 devstack cinder-volume[83076]: DEBUG dbcounter [-] [83076] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83076) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:05 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:06 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=3 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Flow 'volume_create_manager' (b5079e8d-b98a-4bea-837a-433b1baee32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccad31b-1a84-44d9-8b4e-a69db575aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccad31b-1a84-44d9-8b4e-a69db575aad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-358012919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5f8cf-bfaa-4508-ba5a-e3aec689a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fa3deef790496d8eb2fa96276a3b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='a551002d41ee48e0a1f5d266b010ddc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab20a6ee-21e2-4abb-963e-0a33fbf1cbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab20a6ee-21e2-4abb-963e-0a33fbf1cbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5834bc77-87ac-435a-92f8-47a99ddd8c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5834bc77-87ac-435a-92f8-47a99ddd8c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c5f8cf-bfaa-4508-ba5a-e3aec689a521', 'volume_name': 'volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0f68cb-b556-4240-bb43-1af653888572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0f68cb-b556-4240-bb43-1af653888572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dead7d-e882-438c-943d-a2f000851637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Volume 23c5f8cf-bfaa-4508-ba5a-e3aec689a521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521', 'volume_size': 1} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-358012919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5f8cf-bfaa-4508-ba5a-e3aec689a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fa3deef790496d8eb2fa96276a3b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='a551002d41ee48e0a1f5d266b010ddc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Creating volume 23c5f8cf-bfaa-4508-ba5a-e3aec689a521 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:12 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:04:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 1073741824 Feb 27 02:04:12 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:04:13 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Flow 'volume_create_manager' (ff89e6d8-f055-451f-a50b-457d8b0d11b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2d352c-5f05-4c3f-802b-73bfcec1415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2d352c-5f05-4c3f-802b-73bfcec1415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-241768239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd10876-7b56-4fa5-aa6c-08248ef08ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a1d617c40843508c062bf3dfdc57a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:14Z,use_quota=True,user_id='04fab6ccda1a41b5a8ff10db03512040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4156c9-e62e-4815-835d-35ced6b3f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4156c9-e62e-4815-835d-35ced6b3f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f374de87-77da-4c27-8272-fcf295b24f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f374de87-77da-4c27-8272-fcf295b24f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd10876-7b56-4fa5-aa6c-08248ef08ea2', 'volume_name': 'volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f6b23-4e9d-4d71-b1b4-95d9aacfd634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9f6b23-4e9d-4d71-b1b4-95d9aacfd634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c722379e-6fee-4f10-b157-f569d54186f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:13 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Volume 2bd10876-7b56-4fa5-aa6c-08248ef08ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2', 'volume_size': 1} Feb 27 02:04:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:14 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.438s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:15 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 1073741824" returned: 0 in 2.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 Feb 27 02:04:15 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" returned: 0 in 0.874s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] <== create_volume: return (3546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.553s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-241768239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd10876-7b56-4fa5-aa6c-08248ef08ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a1d617c40843508c062bf3dfdc57a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:14Z,use_quota=True,user_id='04fab6ccda1a41b5a8ff10db03512040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Creating volume 2bd10876-7b56-4fa5-aa6c-08248ef08ea2 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:16 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dead7d-e882-438c-943d-a2f000851637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d64b44-2582-44b7-8639-b7353a4ffdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 1073741824 Feb 27 02:04:16 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Volume volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 (23c5f8cf-bfaa-4508-ba5a-e3aec689a521): created successfully Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d64b44-2582-44b7-8639-b7353a4ffdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Flow 'volume_create_manager' (b5079e8d-b98a-4bea-837a-433b1baee32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5be04e22-5fda-4ba0-89e5-82b654ec44ac tempest-DeleteServersTestJSON-1680504497 None] Created volume successfully. Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Flow 'volume_create_manager' (10ae7f96-72d2-4d03-9b17-0000b1491e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbbb094-4a64-4901-af1a-dd9a3f43952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbbb094-4a64-4901-af1a-dd9a3f43952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:16Z,deleted=False,deleted_at=None,display_description='',display_name='599c65cf-f3bd-4719-a56e-e20694955caf-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9f2e6-0e97-4c76-aa34-b6fe47a25890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd76ec1316d48798668697a6a7b96a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:16Z,use_quota=True,user_id='f2a3b3a32afc4a088009e48e6aeed7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0a4dc0-3aff-4b46-a444-f1b4f0affd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0a4dc0-3aff-4b46-a444-f1b4f0affd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1021cc2f-5037-46b2-9d32-80b76860c07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1021cc2f-5037-46b2-9d32-80b76860c07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d9f2e6-0e97-4c76-aa34-b6fe47a25890', 'volume_name': 'volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f31bde-79eb-4556-9e6a-d965c8a24782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f31bde-79eb-4556-9e6a-d965c8a24782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c305e43c-2195-449a-a665-07076f83f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume 95d9f2e6-0e97-4c76-aa34-b6fe47a25890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890', 'volume_size': 1} Feb 27 02:04:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 1073741824" returned: 0 in 2.236s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[84085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 Feb 27 02:04:18 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" returned: 0 in 0.931s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] <== create_volume: return (3248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.253s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:16Z,deleted=False,deleted_at=None,display_description='',display_name='599c65cf-f3bd-4719-a56e-e20694955caf-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d9f2e6-0e97-4c76-aa34-b6fe47a25890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd76ec1316d48798668697a6a7b96a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:16Z,use_quota=True,user_id='f2a3b3a32afc4a088009e48e6aeed7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Creating volume 95d9f2e6-0e97-4c76-aa34-b6fe47a25890 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:19 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[84088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 1073741824 Feb 27 02:04:19 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c722379e-6fee-4f10-b157-f569d54186f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd2f2fe-0d75-48a8-9524-0c6f51522d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Volume volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 (2bd10876-7b56-4fa5-aa6c-08248ef08ea2): created successfully Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd2f2fe-0d75-48a8-9524-0c6f51522d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Flow 'volume_create_manager' (ff89e6d8-f055-451f-a50b-457d8b0d11b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6f8545bb-8c42-43ea-93c5-c7d76112eab8 tempest-VolumesAdminNegativeTest-1444178101 None] Created volume successfully. Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Acquiring lock "cinder-2bd10876-7b56-4fa5-aa6c-08248ef08ea2-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "cinder-2bd10876-7b56-4fa5-aa6c-08248ef08ea2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Acquiring lock "cinder-quobyte-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "cinder-quobyte-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:20 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3qiys2c5/privsep.sock'] Feb 27 02:04:20 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3qiys2c5/privsep.sock Feb 27 02:04:20 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 1073741824" returned: 0 in 1.639s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 Feb 27 02:04:21 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:22 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" returned: 0 in 1.868s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] <== create_volume: return (3569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.576s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c305e43c-2195-449a-a665-07076f83f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a3db35-ed61-4c24-8a74-45821d36646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 (95d9f2e6-0e97-4c76-aa34-b6fe47a25890): created successfully Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a3db35-ed61-4c24-8a74-45821d36646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Flow 'volume_create_manager' (10ae7f96-72d2-4d03-9b17-0000b1491e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-f21d5df1-d8b9-47d8-8600-d3822ab3728c tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Created volume successfully. Feb 27 02:04:24 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:24 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Spawned new privsep daemon via rootwrap Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Accepted privsep connection to /tmp/tmp3qiys2c5/privsep.sock {{(pid=83211) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 02:04:24 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 02:04:24 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 02:04:24 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 02:04:24 devstack cinder-volume[83211]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84104 Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba1e91-312b-4675-a748-4807e76356e2]: (2,) {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9635b-e68e-444b-a9bb-40abe112fef7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:24 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 Feb 27 02:04:24 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:24 devstack cinder-volume[83211]: WARNING py.warnings [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 27 02:04:24 devstack cinder-volume[83211]: .first() Feb 27 02:04:24 devstack cinder-volume[83211]: Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78aa1c1-2221-4670-8710-834f33caa56f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:24 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 Feb 27 02:04:24 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:25 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" returned: 0 in 0.975s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:25 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2 Feb 27 02:04:25 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" returned: 0 in 1.311s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:26 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "cinder-quobyte-2bd10876-7b56-4fa5-aa6c-08248ef08ea2" released by "delete_volume" :: held 5.828s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" returned: 0 in 1.758s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.818s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:26 devstack cinder-volume[83211]: WARNING cinder.quota [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:26 devstack cinder-volume[83211]: WARNING cinder.quota [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Created reservations ['92116241-6635-4f1d-bc31-e05670444a0e', '499cb793-c28c-4c64-b262-883902733c74', '35d88157-c743-42ed-b286-ce78e90710ea', '30217d50-256d-485e-9fe7-2a140482b568'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9', 'name': 'volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2574eae-9927-4052-be89-2b184cadfd40', 'enforce_multipath': True} {{(pid=83211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e51d138-7f0f-4b0f-ba74-5f9e1cc848d6]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:26 devstack sudo[84169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:04:26 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:26 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-3e0ddedc-a268-45f8-8d7d-c08cdb0e660c req-2210e93e-f096-418f-9b36-783ffa780ba8 tempest-DeleteServersTestJSON-1680504497 None] attachment_update completed successfully. Feb 27 02:04:26 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 Feb 27 02:04:26 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.124s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Deleted volume successfully. Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3042b24c-5e59-4926-b4b9-8b6ac1468868 tempest-VolumesAdminNegativeTest-1444178101 None] Lock "cinder-2bd10876-7b56-4fa5-aa6c-08248ef08ea2-delete_volume" released by "delete_volume" :: held 7.544s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:28 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" returned: 0 in 1.540s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.638s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9', 'name': 'volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b15e96d-cf15-4892-be92-3aa44210cf16', 'enforce_multipath': True} {{(pid=83211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:04:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-a6ec8d2d-4604-4914-94b5-1cbce02cbfc5 req-034bfe03-41b4-4bfc-9534-36ec73d2b331 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] attachment_update completed successfully. Feb 27 02:04:36 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-8fb27e62-84fb-459b-937d-49f8a639bb0d req-a68fb3e0-e1a9-4511-9f16-e0b418c112e8 tempest-DeleteServersTestJSON-1680504497 None] Terminate volume connection completed successfully. Feb 27 02:04:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-8fb27e62-84fb-459b-937d-49f8a639bb0d req-a68fb3e0-e1a9-4511-9f16-e0b418c112e8 tempest-DeleteServersTestJSON-1680504497 None] Deleting attachment b2574eae-9927-4052-be89-2b184cadfd40. {{(pid=83211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "cinder-23c5f8cf-bfaa-4508-ba5a-e3aec689a521-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "cinder-23c5f8cf-bfaa-4508-ba5a-e3aec689a521-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "cinder-quobyte-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "cinder-quobyte-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[089d931e-0cbf-4652-bc09-0079fd6a75df]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:40 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 Feb 27 02:04:40 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:41 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" returned: 0 in 0.720s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521 Feb 27 02:04:41 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" returned: 0 in 0.649s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "cinder-quobyte-23c5f8cf-bfaa-4508-ba5a-e3aec689a521" released by "delete_volume" :: held 1.404s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Created reservations ['6499ed18-1675-42b8-8631-8707e1c72cbf', '2181430b-d843-4113-8b64-70863a32f01e', '4e281cff-6643-44e9-89ac-85caf65fe16e', '6156d1eb-b304-4a4c-a03e-330ee8462013'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:04:42 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.697s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Deleted volume successfully. Feb 27 02:04:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-21bac7cb-f703-4b3a-b233-e3fffe5a54e9 tempest-DeleteServersTestJSON-1680504497 None] Lock "cinder-23c5f8cf-bfaa-4508-ba5a-e3aec689a521-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:52 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=32,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Flow 'volume_create_manager' (3e33097a-3ec7-4a5c-9b77-c369eaf598ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ff9aa3-775b-436b-8582-97c1c283e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ff9aa3-775b-436b-8582-97c1c283e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1664522041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67eedd-07e7-4664-b625-14f9ed551b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd6d533070fb431fb1b2d95f9804883d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:53Z,use_quota=True,user_id='94312412f3964319a7a2be4b44d0e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949d095-2d33-401e-9c25-82f1321e8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949d095-2d33-401e-9c25-82f1321e8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f272b3-28f2-4c27-8e44-db6a70df9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f272b3-28f2-4c27-8e44-db6a70df9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da67eedd-07e7-4664-b625-14f9ed551b53', 'volume_name': 'volume-da67eedd-07e7-4664-b625-14f9ed551b53', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad612a3-b655-4f8a-a5d0-2f4763cf6b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad612a3-b655-4f8a-a5d0-2f4763cf6b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265cae82-3a36-4da1-9d1c-916cd27d0c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Volume da67eedd-07e7-4664-b625-14f9ed551b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da67eedd-07e7-4664-b625-14f9ed551b53', 'volume_size': 1} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1664522041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67eedd-07e7-4664-b625-14f9ed551b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd6d533070fb431fb1b2d95f9804883d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:53Z,use_quota=True,user_id='94312412f3964319a7a2be4b44d0e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Creating volume da67eedd-07e7-4664-b625-14f9ed551b53 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:53 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:04:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 1073741824 Feb 27 02:04:53 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:54 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 1073741824" returned: 0 in 1.225s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:55 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 Feb 27 02:04:55 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53" returned: 0 in 0.848s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265cae82-3a36-4da1-9d1c-916cd27d0c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da67eedd-07e7-4664-b625-14f9ed551b53', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473cf86e-40e6-4e3b-b94a-ae684f827401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Volume volume-da67eedd-07e7-4664-b625-14f9ed551b53 (da67eedd-07e7-4664-b625-14f9ed551b53): created successfully Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473cf86e-40e6-4e3b-b94a-ae684f827401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Flow 'volume_create_manager' (3e33097a-3ec7-4a5c-9b77-c369eaf598ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-fbcc4ef5-eff0-4484-a9da-f2b02a86cbcc req-f8a25321-a12d-44df-8c71-fd89667516d1 tempest-VolumesGetTestJSON-1299926356 None] Created volume successfully. Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Acquiring lock "cinder-da67eedd-07e7-4664-b625-14f9ed551b53-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "cinder-da67eedd-07e7-4664-b625-14f9ed551b53-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Acquiring lock "cinder-quobyte-da67eedd-07e7-4664-b625-14f9ed551b53" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "cinder-quobyte-da67eedd-07e7-4664-b625-14f9ed551b53" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[351c6911-1f88-48dc-8eb9-333c8642e0c4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 Feb 27 02:04:57 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53" returned: 0 in 0.649s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53 Feb 27 02:04:58 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9780c3d4-b271-47df-afdc-b4efbbb4c0e6 tempest-GroupSnapshotsV319Test-1528587783 None] Group tempest-GroupSnapshotsV319Test-Group-1451544164: creating Feb 27 02:04:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9780c3d4-b271-47df-afdc-b4efbbb4c0e6 tempest-GroupSnapshotsV319Test-1528587783 None] Group tempest-GroupSnapshotsV319Test-Group-1451544164: created successfully Feb 27 02:04:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9780c3d4-b271-47df-afdc-b4efbbb4c0e6 tempest-GroupSnapshotsV319Test-1528587783 None] Create group completed successfully. Feb 27 02:04:59 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-da67eedd-07e7-4664-b625-14f9ed551b53" returned: 0 in 0.931s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "cinder-quobyte-da67eedd-07e7-4664-b625-14f9ed551b53" released by "delete_volume" :: held 1.618s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.quota [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Created reservations ['562d30e3-48b0-442a-a06b-528bedff63fb', '2f5b7445-09a8-42f9-9749-7cdd6a83ac93', '5e7f2a74-e27a-4db0-8fd4-a42af677274b', 'eaa9eb38-ac1d-4226-94ca-d54de6eb2a54'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:04:59 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.672s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.manager [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Deleted volume successfully. Feb 27 02:04:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-09437967-adc5-4d3a-b84e-cb10d2bf15f9 req-0ef43d7d-2b6d-490a-b52f-413be9ae5051 tempest-VolumesGetTestJSON-1299926356 None] Lock "cinder-da67eedd-07e7-4664-b625-14f9ed551b53-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:00 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Flow 'volume_create_manager' (e3006632-2280-4163-8af7-2cb700d11b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71455b6b-52db-4e9b-8bcc-c1e4fad17cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71455b6b-52db-4e9b-8bcc-c1e4fad17cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1806572129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0f6b547-500e-466a-bd2f-66b4da6b9bce,host='devstack@QuobyteHD#QuobyteHD',id=ae70cbed-aaa2-4e7b-be13-90ab13ed40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5279b41c0384457ba1f65e29f633a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:01Z,use_quota=True,user_id='58fd22bf94c84ea89791b90f7053d8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b1903d4-8990-43e7-8cd3-0c27b1c4268b),volume_type_id=3b1903d4-8990-43e7-8cd3-0c27b1c4268b)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863370e2-c920-4b51-9c6e-9df64faa6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863370e2-c920-4b51-9c6e-9df64faa6042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72fbaf-7952-40f1-a4eb-7191a98d8cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be72fbaf-7952-40f1-a4eb-7191a98d8cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae70cbed-aaa2-4e7b-be13-90ab13ed40f2', 'volume_name': 'volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4357a161-af79-479e-a33c-c88d441c0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4357a161-af79-479e-a33c-c88d441c0091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36a52b-7804-41d5-ae4d-29fd3c1a0169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:01 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Volume ae70cbed-aaa2-4e7b-be13-90ab13ed40f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2', 'volume_size': 1} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0f6b547-500e-466a-bd2f-66b4da6b9bce,created_at=2026-02-27T01:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1806572129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0f6b547-500e-466a-bd2f-66b4da6b9bce,host='devstack@QuobyteHD#QuobyteHD',id=ae70cbed-aaa2-4e7b-be13-90ab13ed40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5279b41c0384457ba1f65e29f633a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:01Z,use_quota=True,user_id='58fd22bf94c84ea89791b90f7053d8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b1903d4-8990-43e7-8cd3-0c27b1c4268b),volume_type_id=3b1903d4-8990-43e7-8cd3-0c27b1c4268b)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Creating volume ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:01 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 1073741824 Feb 27 02:05:01 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 1073741824" returned: 0 in 1.656s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 Feb 27 02:05:02 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" returned: 0 in 0.754s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36a52b-7804-41d5-ae4d-29fd3c1a0169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba28cbbd-bbab-4cbc-9aa0-f9c258174d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Volume volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 (ae70cbed-aaa2-4e7b-be13-90ab13ed40f2): created successfully Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba28cbbd-bbab-4cbc-9aa0-f9c258174d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Flow 'volume_create_manager' (e3006632-2280-4163-8af7-2cb700d11b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9f80281e-df17-4191-9d69-ee1bc131e1e6 tempest-GroupSnapshotsV319Test-1528587783 None] Created volume successfully. Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Flow 'volume_create_manager' (d150ae0a-6006-4e0c-ba58-23ec9bb49fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149d837f-f931-493b-8527-117fb7e7e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149d837f-f931-493b-8527-117fb7e7e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1612366071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005d7678-e300-4542-9486-80f9d8b6dfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4220883f5d4f3eb3ba690de700721f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:04Z,use_quota=True,user_id='f1328ca4a5334536886de6724da5dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b4224-9de3-46b2-8078-db9bad8ddbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32b4224-9de3-46b2-8078-db9bad8ddbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dc237a-b3f9-4799-96fd-d07e9f66214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dc237a-b3f9-4799-96fd-d07e9f66214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005d7678-e300-4542-9486-80f9d8b6dfe1', 'volume_name': 'volume-005d7678-e300-4542-9486-80f9d8b6dfe1', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4cd500-2e77-4085-975b-e40eb2453d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4cd500-2e77-4085-975b-e40eb2453d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d705b-e010-42aa-bb0f-af29144055da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:04 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Volume 005d7678-e300-4542-9486-80f9d8b6dfe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005d7678-e300-4542-9486-80f9d8b6dfe1', 'volume_size': 1} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1612366071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005d7678-e300-4542-9486-80f9d8b6dfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4220883f5d4f3eb3ba690de700721f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:04Z,use_quota=True,user_id='f1328ca4a5334536886de6724da5dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Creating volume 005d7678-e300-4542-9486-80f9d8b6dfe1 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:04 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 1073741824 Feb 27 02:05:04 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2de36802-0f83-416b-a88a-25d454e0bcd7 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-1328403789: creating Feb 27 02:05:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2de36802-0f83-416b-a88a-25d454e0bcd7 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-1328403789: created successfully Feb 27 02:05:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2de36802-0f83-416b-a88a-25d454e0bcd7 tempest-GroupSnapshotsTest-2064436582 None] Create group completed successfully. Feb 27 02:05:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] GroupSnapshot b6107a29-43e6-418e-93df-b9827c03e3a6: creating. Feb 27 02:05:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Group snapshot b6107a29-43e6-418e-93df-b9827c03e3a6: creating. {{(pid=83211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:05:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:05 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 1073741824" returned: 0 in 1.293s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 Feb 27 02:05:05 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (90648a0a-8854-43cd-9fdf-25d4f1d4af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72132def-e7d7-477b-b79c-3e5407342d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72132def-e7d7-477b-b79c-3e5407342d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671016922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e32a872d-6ba2-45ef-838a-aa628521e8b3,host='devstack@QuobyteHD#QuobyteHD',id=f25c6c41-59d2-4a86-a4ba-173702519ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:07Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae735231-96e6-409d-b225-9e06d5fd50f1),volume_type_id=ae735231-96e6-409d-b225-9e06d5fd50f1)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85ca18f-9a79-4107-8dd8-26992d9784e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85ca18f-9a79-4107-8dd8-26992d9784e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db5db63-d150-4b59-a61a-ed48ecd93113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db5db63-d150-4b59-a61a-ed48ecd93113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f25c6c41-59d2-4a86-a4ba-173702519ede', 'volume_name': 'volume-f25c6c41-59d2-4a86-a4ba-173702519ede', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5923435-9cba-4235-814a-90abdb40099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5923435-9cba-4235-814a-90abdb40099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d1247b-84b8-4641-a6ec-faa667463cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Volume f25c6c41-59d2-4a86-a4ba-173702519ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f25c6c41-59d2-4a86-a4ba-173702519ede', 'volume_size': 1} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:06 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1" returned: 0 in 1.150s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] <== create_volume: return (2493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.496s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.537s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66d705b-e010-42aa-bb0f-af29144055da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005d7678-e300-4542-9486-80f9d8b6dfe1', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e956ba-97c6-4deb-a3c2-0009e7c19363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Creating offline snapshot 5754a6e1-4829-4a6d-98d0-f647a1fefe93 of volume ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Volume volume-005d7678-e300-4542-9486-80f9d8b6dfe1 (005d7678-e300-4542-9486-80f9d8b6dfe1): created successfully Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e956ba-97c6-4deb-a3c2-0009e7c19363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Flow 'volume_create_manager' (d150ae0a-6006-4e0c-ba58-23ec9bb49fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb489be5-49d0-4f3b-8c3c-2df35245a0c0]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-98f58f03-586f-47aa-88cc-bd886abdef51 tempest-ServerRescueNegativeTestJSON-1268440260 None] Created volume successfully. Feb 27 02:05:07 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 Feb 27 02:05:07 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" returned: 0 in 0.911s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 1G Feb 27 02:05:07 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 1G" returned: 0 in 0.627s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 Feb 27 02:05:08 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93" returned: 0 in 0.720s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 Feb 27 02:05:09 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93" returned: 0 in 0.685s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info Feb 27 02:05:09 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:10 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[85132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info Feb 27 02:05:10 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.info" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.137s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.232s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e32a872d-6ba2-45ef-838a-aa628521e8b3,created_at=2026-02-27T01:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671016922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e32a872d-6ba2-45ef-838a-aa628521e8b3,host='devstack@QuobyteHD#QuobyteHD',id=f25c6c41-59d2-4a86-a4ba-173702519ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:07Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae735231-96e6-409d-b225-9e06d5fd50f1),volume_type_id=ae735231-96e6-409d-b225-9e06d5fd50f1)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Creating volume f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:11 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede 1073741824 Feb 27 02:05:11 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5e0e2db4-e350-4c2c-878a-1a70063660e0 tempest-GroupSnapshotsV319Test-1528587783 None] group_snapshot b6107a29-43e6-418e-93df-b9827c03e3a6: created successfully Feb 27 02:05:11 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede 1073741824" returned: 0 in 0.676s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:11 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] group_snapshot b6107a29-43e6-418e-93df-b9827c03e3a6: deleting Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] group_snapshot b6107a29-43e6-418e-93df-b9827c03e3a6: deleting {{(pid=83211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "cinder-quobyte-5754a6e1-4829-4a6d-98d0-f647a1fefe93" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-5754a6e1-4829-4a6d-98d0-f647a1fefe93" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Deleting offline snapshot 5754a6e1-4829-4a6d-98d0-f647a1fefe93 of volume ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] snapshot_file for this snap is: volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d51028-a864-48d3-84c0-00f2cc83cc2c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 0.889s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 Feb 27 02:05:12 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d1247b-84b8-4641-a6ec-faa667463cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25c6c41-59d2-4a86-a4ba-173702519ede', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fc7942-e79e-429b-9193-a52880f2f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Volume volume-f25c6c41-59d2-4a86-a4ba-173702519ede (f25c6c41-59d2-4a86-a4ba-173702519ede): created successfully Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fc7942-e79e-429b-9193-a52880f2f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (90648a0a-8854-43cd-9fdf-25d4f1d4af14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-28c4b7d7-6a6e-472e-bff9-a03b72c45555 tempest-GroupSnapshotsTest-2064436582 None] Created volume successfully. Feb 27 02:05:13 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93" returned: 0 in 0.938s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b0afa-0607-45d9-a10a-f5eb1b79742d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:13 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:13 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 Feb 27 02:05:13 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] GroupSnapshot 2591f783-2439-4757-9003-c63d0164e72f: creating. Feb 27 02:05:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Group snapshot 2591f783-2439-4757-9003-c63d0164e72f: creating. {{(pid=83211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Creating offline snapshot 1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 of volume f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210c602-5f10-4d0b-8ef6-7765bff863f3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" returned: 0 in 0.754s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:14 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 Feb 27 02:05:14 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.121s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:15 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 0.990s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93" returned: 0 in 0.858s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 1G Feb 27 02:05:15 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93 Feb 27 02:05:15 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2.5754a6e1-4829-4a6d-98d0-f647a1fefe93" returned: 0 in 0.483s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-5754a6e1-4829-4a6d-98d0-f647a1fefe93" released by "_delete_snapshot" :: held 3.215s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" released by "delete_snapshot" :: held 3.229s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:15 devstack cinder-volume[83211]: WARNING cinder.quota [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1633234299 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1633234299, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:15 devstack cinder-volume[83211]: WARNING cinder.quota [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1633234299 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1633234299, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] Created reservations ['9a636b39-af07-46ff-a924-3ff48fddc779', 'df199ae4-ed03-49b1-99c3-e9622bf709ba', '916c010d-bfd3-44f9-ae76-9ee72bb7210b', '32dad137-b8e0-40e8-9c16-d670b9938f81'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:15 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 1G" returned: 0 in 0.757s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c6c41-59d2-4a86-a4ba-173702519ede -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c6c41-59d2-4a86-a4ba-173702519ede -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:15 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-32a62194-e6cb-4288-b1fc-9166706f1a53 tempest-GroupSnapshotsV319Test-1528587783 None] group_snapshot b6107a29-43e6-418e-93df-b9827c03e3a6: deleted successfully Feb 27 02:05:16 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25c6c41-59d2-4a86-a4ba-173702519ede -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 0.675s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:16 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:16 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:16 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 0.701s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info Feb 27 02:05:17 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" acquired by "delete_volume" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[893019e6-5fb1-48aa-a62a-f0a447bb0f84]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 Feb 27 02:05:18 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info" returned: 0 in 1.186s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info Feb 27 02:05:18 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" returned: 0 in 0.935s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2 Feb 27 02:05:18 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.info" returned: 0 in 0.631s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.135s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6566b828-6941-48be-b8ed-ad17f6bddfe7 tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2591f783-2439-4757-9003-c63d0164e72f: created successfully Feb 27 02:05:19 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" returned: 0 in 0.839s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "cinder-quobyte-ae70cbed-aaa2-4e7b-be13-90ab13ed40f2" released by "delete_volume" :: held 1.968s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Created reservations ['e4567b12-eb31-4204-8954-64273c09c0f6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:19 devstack cinder-volume[83211]: WARNING cinder.quota [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1633234299 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1633234299, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Created reservations ['606230d2-044c-43fc-a60a-faff6952d554', 'f527307a-e1bc-4fbb-ae6b-03fa4f9564e9', '38dbb68b-33af-4578-8422-4d8b2baccbfb', 'ab3acb38-24d0-4deb-8c7d-0a59aca53687'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:19 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:20 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3-732608e7-6324-45c4-ac54-16116ce975a9" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.136s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-61d42666-f854-45c5-8593-5f66b671a4c7 tempest-GroupSnapshotsV319Test-1528587783 None] Delete group completed successfully. Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3-732608e7-6324-45c4-ac54-16116ce975a9" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Creating volume 732608e7-6324-45c4-ac54-16116ce975a9 from snapshot 1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] snapshot: 1b5e86cb-b4be-4d7c-9e8d-57f578696bd3, volume: 732608e7-6324-45c4-ac54-16116ce975a9, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fff232-f4a2-497c-b90d-d0914fee60a2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:21 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 1.321s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f25c6c41-59d2-4a86-a4ba-173702519ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990afff-61b7-4edc-9510-9e0bdec90078]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:22 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:24 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 1.764s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:24 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:05:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:24 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 Feb 27 02:05:24 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Acquiring lock "cinder-005d7678-e300-4542-9486-80f9d8b6dfe1-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "cinder-005d7678-e300-4542-9486-80f9d8b6dfe1-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Acquiring lock "cinder-quobyte-005d7678-e300-4542-9486-80f9d8b6dfe1" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "cinder-quobyte-005d7678-e300-4542-9486-80f9d8b6dfe1" acquired by "delete_volume" :: waited 0.074s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204f648-52b9-4543-8571-6e9096ed2b63]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:28 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 Feb 27 02:05:28 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9" returned: 0 in 6.124s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e284b-1ee9-4813-a6c9-156c11f74b81]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:30 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:30 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1" returned: 0 in 2.821s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1 Feb 27 02:05:30 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:31 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-005d7678-e300-4542-9486-80f9d8b6dfe1" returned: 0 in 0.749s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "cinder-quobyte-005d7678-e300-4542-9486-80f9d8b6dfe1" released by "delete_volume" :: held 3.710s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Created reservations ['f4162e25-e1da-4343-9ac6-243ab662d0e8', '5355d945-04f0-48cb-9c49-d6651a47bd16', 'e389c3f2-e2c9-4343-9b14-2084b6fb3247', 'ccacf5fd-012f-4ed0-8013-5afb8a064906'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:31 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:31 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 1.886s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:32 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Converted 1024.00 MB image at 167.17 MB/s Feb 27 02:05:32 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:32 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 Feb 27 02:05:32 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:32 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.863s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:32 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Deleted volume successfully. Feb 27 02:05:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-81e81b5a-cefe-41fe-9eb7-551e0f4f1086 tempest-ServerRescueNegativeTestJSON-1268440260 None] Lock "cinder-005d7678-e300-4542-9486-80f9d8b6dfe1-delete_volume" released by "delete_volume" :: held 5.206s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:33 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9" returned: 0 in 0.986s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" released by "_copy_volume_from_snapshot" :: held 12.238s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3-732608e7-6324-45c4-ac54-16116ce975a9" released by "_create_volume_from_snapshot" :: held 12.292s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.323s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c6281905-44e9-4952-87f9-29bb9c43d58b tempest-GroupSnapshotsTest-2064436582 None] Create group from source-snapshot-2591f783-2439-4757-9003-c63d0164e72f completed successfully. Feb 27 02:05:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:34 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308c7e1-8a9f-47c9-94d4-ff8394dc7ddb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:34 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 Feb 27 02:05:34 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9" returned: 0 in 1.417s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9 Feb 27 02:05:35 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:36 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-732608e7-6324-45c4-ac54-16116ce975a9" returned: 0 in 0.744s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-732608e7-6324-45c4-ac54-16116ce975a9" released by "delete_volume" :: held 2.326s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['99ab249d-86ca-4673-acc4-a7286cf9c861'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:36 devstack cinder-volume[83211]: WARNING cinder.quota [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-444052131 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-444052131, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:36 devstack cinder-volume[83211]: WARNING cinder.quota [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-444052131 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-444052131, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['b24bb30f-9e40-44ed-8953-6d86dc3ebd00', '1d5480b1-06a5-49eb-ad01-f31da6e712cb', 'af47f84e-ae9a-4587-8b7f-f246c363080d', 'ca882774-3a1a-4d26-a945-77cc10b2c62e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:36 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.891s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6ab88237-0e51-43cf-a881-f3d8275db9ab tempest-GroupSnapshotsTest-2064436582 None] Delete group completed successfully. Feb 27 02:05:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2591f783-2439-4757-9003-c63d0164e72f: deleting Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2591f783-2439-4757-9003-c63d0164e72f: deleting {{(pid=83211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Deleting offline snapshot 1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 of volume f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:38 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] snapshot_file for this snap is: volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:38 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[92404e06-71fb-4fc6-b96d-2f03f8ffc6e3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:38 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 1.289s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f25c6c41-59d2-4a86-a4ba-173702519ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463d508-8c7f-4ef6-94b5-2c246d12e6e7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:39 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Flow 'volume_create_manager' (9ebbe017-4068-4cfd-be0d-a57864b0df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83aa137f-e3af-4e2a-ae63-be918235e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83aa137f-e3af-4e2a-ae63-be918235e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bb4837-687e-44c1-a1b8-47fbac8699f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd76ec1316d48798668697a6a7b96a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:40Z,use_quota=True,user_id='f2a3b3a32afc4a088009e48e6aeed7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2d8c44-fba2-40ff-a37d-93d33833dd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2d8c44-fba2-40ff-a37d-93d33833dd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc81ee-4116-46d5-a4a5-1425869cb475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG cinder.image.glance [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Creating Keystone auth plugin from conf {{(pid=83211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:05:40 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 1.499s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:41 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc81ee-4116-46d5-a4a5-1425869cb475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43bb4837-687e-44c1-a1b8-47fbac8699f9', 'volume_name': 'volume-43bb4837-687e-44c1-a1b8-47fbac8699f9', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741c399e-a168-4336-a83f-36eb8b7a65c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741c399e-a168-4336-a83f-36eb8b7a65c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fe374e-f001-4f8d-9422-c86d6c2ab87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume 43bb4837-687e-44c1-a1b8-47fbac8699f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43bb4837-687e-44c1-a1b8-47fbac8699f9', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Trying to clone 43bb4837-687e-44c1-a1b8-47fbac8699f9 from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]). {{(pid=83211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:05:41 devstack cinder-volume[83211]: INFO cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69b20f-b753-4b26-b944-6c023e21b1b3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 1.095s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3 Feb 27 02:05:42 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:42 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD Feb 27 02:05:42 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede.1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" returned: 0 in 1.101s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD" returned: 0 in 1.267s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 is fetched for user f2a3b3a32afc4a088009e48e6aeed7a2. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-1b5e86cb-b4be-4d7c-9e8d-57f578696bd3" released by "_delete_snapshot" :: held 5.231s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" released by "delete_snapshot" :: held 5.255s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f62506-5bc3-467c-a165-31401a644e6f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:43 devstack cinder-volume[83211]: WARNING cinder.quota [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-444052131 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-444052131, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['481aaf6c-b4dc-4f9b-957f-a5ed69e5e35c', 'c7c236d0-e638-4be5-a22a-9906bb1f49ce', 'ebf530d3-1cd5-4ddb-943c-36eaaae793c4', '68b82c49-468e-430a-96c9-9dac3139c491'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:43 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD Feb 27 02:05:43 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1d3bf746-c876-4d5c-a7ac-c4cd963d4acb tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2591f783-2439-4757-9003-c63d0164e72f: deleted successfully Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dafa0e5-2dc3-4ab8-96f6-e2506ce120ae]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD" returned: 0 in 0.805s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bb4837-687e-44c1-a1b8-47fbac8699f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd76ec1316d48798668697a6a7b96a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:40Z,use_quota=True,user_id='f2a3b3a32afc4a088009e48e6aeed7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Creating volume 43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:44 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1073741824 Feb 27 02:05:44 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:44 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 0.908s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede Feb 27 02:05:45 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1073741824" returned: 0 in 0.912s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:45 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 0.641s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:45 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Attempting download of 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 43bb4837-687e-44c1-a1b8-47fbac8699f9. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f25c6c41-59d2-4a86-a4ba-173702519ede" returned: 0 in 0.771s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f25c6c41-59d2-4a86-a4ba-173702519ede" released by "delete_volume" :: held 1.770s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3278101d-9920-4b7e-ad3a-52b2e1f3de7b]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['f2e02700-b15c-4000-a024-b6ea6d1ba4b4'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:45 devstack cinder-volume[83211]: WARNING cinder.db.sqlalchemy.api [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-444052131'] Feb 27 02:05:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['c46af24c-3972-48da-9a16-2af750e30669', '40d3023f-bb04-46b6-9fd9-2fa8053a4582', 'bd62858c-4c72-4ea7-9139-25e621b12ec4', '7a196bd9-c3cf-44a0-a99d-19818fc50db4'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:45 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm Feb 27 02:05:45 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:46 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm" returned: 0 in 0.703s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.573s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f3190881-a04e-41fe-add0-163f923bb414 tempest-GroupSnapshotsTest-2064436582 None] Delete group completed successfully. Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ef67b121-7ec6-4372-b37e-9a329deb8bcd tempest-GroupsTest-1439379381 None] Group tempest-Group1-293514849: creating Feb 27 02:05:46 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm Feb 27 02:05:46 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ef67b121-7ec6-4372-b37e-9a329deb8bcd tempest-GroupsTest-1439379381 None] Group tempest-Group1-293514849: created successfully Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ef67b121-7ec6-4372-b37e-9a329deb8bcd tempest-GroupsTest-1439379381 None] Create group completed successfully. Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-daad04ed-1648-4795-a46a-8a5f479339e1 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-1620586298: creating Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-daad04ed-1648-4795-a46a-8a5f479339e1 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-1620586298: created successfully Feb 27 02:05:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-daad04ed-1648-4795-a46a-8a5f479339e1 tempest-GroupSnapshotsTest-2064436582 None] Create group completed successfully. Feb 27 02:05:47 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm" returned: 1 in 0.748s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_8emhpdtm' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6813713-59ae-498c-a020-35651165f1e0]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD Feb 27 02:05:47 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8c5020da-edbf-4fe8-834f-fcbca2bc728e tempest-GroupsTest-1439379381 None] Group tempest-Group2-188583642: creating Feb 27 02:05:47 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD" returned: 0 in 0.584s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] 362137d4-09ea-4da7-92c5-9fdbd53eaec8 was qcow2, converting to raw {{(pid=83211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:05:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8c5020da-edbf-4fe8-834f-fcbca2bc728e tempest-GroupsTest-1439379381 None] Group tempest-Group2-188583642: created successfully Feb 27 02:05:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8c5020da-edbf-4fe8-834f-fcbca2bc728e tempest-GroupsTest-1439379381 None] Create group completed successfully. Feb 27 02:05:47 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:47 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (10224fdb-4535-4805-a893-396ddffbe0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedeb39-c6aa-4478-b63b-75427259b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedeb39-c6aa-4478-b63b-75427259b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680183832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f703cb9f-4689-40c6-9629-b849c963d07b,host='devstack@QuobyteHD#QuobyteHD',id=f350336b-0b77-47c9-9510-fa6179b0e2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa547570-e948-47b7-acff-8056f289ebf0),volume_type_id=aa547570-e948-47b7-acff-8056f289ebf0)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3f6240-9f9a-425b-9a40-24dc0839208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3f6240-9f9a-425b-9a40-24dc0839208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3201c534-ef77-4463-be68-53b529f6d4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3201c534-ef77-4463-be68-53b529f6d4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f350336b-0b77-47c9-9510-fa6179b0e2a7', 'volume_name': 'volume-f350336b-0b77-47c9-9510-fa6179b0e2a7', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7808750-c150-44f7-b3ea-61c955014d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7808750-c150-44f7-b3ea-61c955014d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3668f097-f5a7-484e-909b-900d6917fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Volume f350336b-0b77-47c9-9510-fa6179b0e2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f350336b-0b77-47c9-9510-fa6179b0e2a7', 'volume_size': 1} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f703cb9f-4689-40c6-9629-b849c963d07b,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680183832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f703cb9f-4689-40c6-9629-b849c963d07b,host='devstack@QuobyteHD#QuobyteHD',id=f350336b-0b77-47c9-9510-fa6179b0e2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa547570-e948-47b7-acff-8056f289ebf0),volume_type_id=aa547570-e948-47b7-acff-8056f289ebf0)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Creating volume f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:48 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 1073741824 Feb 27 02:05:48 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 1.371s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_sp6p_b5hdevstack@QuobyteHD, size 112.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:49 devstack cinder-volume[83211]: INFO cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Converted 112.00 MB image at 81.44 MB/s Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1G Feb 27 02:05:49 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (058bf58a-75b8-401b-aeba-bde1d9024015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fd57b6-2a37-4b35-980f-77d676b6af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fd57b6-2a37-4b35-980f-77d676b6af4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480526960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a2d890b-8c89-4d9c-a96b-eeab6db91148,host='devstack@QuobyteHD#QuobyteHD',id=7d189905-217d-4ebb-912d-c7626e8bc6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ee39293-e4ab-4694-b5a2-f74647c01549),volume_type_id=8ee39293-e4ab-4694-b5a2-f74647c01549)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884f1ab2-cb41-4b15-80a6-0837db299dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884f1ab2-cb41-4b15-80a6-0837db299dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49afadce-2c31-4ad9-870e-7875e5116e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49afadce-2c31-4ad9-870e-7875e5116e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d189905-217d-4ebb-912d-c7626e8bc6bc', 'volume_name': 'volume-7d189905-217d-4ebb-912d-c7626e8bc6bc', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348a0540-140c-4260-ab70-a2154dce3ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348a0540-140c-4260-ab70-a2154dce3ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a0b84-8077-4324-8005-f3039129d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Volume 7d189905-217d-4ebb-912d-c7626e8bc6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d189905-217d-4ebb-912d-c7626e8bc6bc', 'volume_size': 1} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:49 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 1073741824" returned: 0 in 1.124s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 Feb 27 02:05:49 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 1G" returned: 0 in 0.728s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1044b10c-8fc1-4f0a-b1bc-0a9d5e0651a7]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:50 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7" returned: 0 in 0.704s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a2d890b-8c89-4d9c-a96b-eeab6db91148,created_at=2026-02-27T01:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480526960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a2d890b-8c89-4d9c-a96b-eeab6db91148,host='devstack@QuobyteHD#QuobyteHD',id=7d189905-217d-4ebb-912d-c7626e8bc6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ee39293-e4ab-4694-b5a2-f74647c01549),volume_type_id=8ee39293-e4ab-4694-b5a2-f74647c01549)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Creating volume 7d189905-217d-4ebb-912d-c7626e8bc6bc {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:50 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3668f097-f5a7-484e-909b-900d6917fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f350336b-0b77-47c9-9510-fa6179b0e2a7', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99efe432-eadc-4d16-9d1b-af9f0ffc7645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:50 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Volume volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 (f350336b-0b77-47c9-9510-fa6179b0e2a7): created successfully Feb 27 02:05:50 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc 1073741824 Feb 27 02:05:50 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99efe432-eadc-4d16-9d1b-af9f0ffc7645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (10224fdb-4535-4805-a893-396ddffbe0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9c5d5d66-1978-4035-9457-7cde4ce6b203 tempest-GroupSnapshotsTest-2064436582 None] Created volume successfully. Feb 27 02:05:50 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 0.642s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:50 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (aa8455c6-7f8a-441b-b8b7-796d29b8a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69bb7d-5f44-4b76-b0e7-61ee0cccaaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc 1073741824" returned: 0 in 1.001s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69bb7d-5f44-4b76-b0e7-61ee0cccaaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966364394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f703cb9f-4689-40c6-9629-b849c963d07b,host='devstack@QuobyteHD#QuobyteHD',id=d2eabdfc-a29c-47e0-b35a-a78c0f8eedca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:51Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa547570-e948-47b7-acff-8056f289ebf0),volume_type_id=aa547570-e948-47b7-acff-8056f289ebf0)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc Feb 27 02:05:51 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28e01a-d87c-4f63-b0a5-278862f5bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba28e01a-d87c-4f63-b0a5-278862f5bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd7740-b517-4b5b-82b1-5561b07448bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd7740-b517-4b5b-82b1-5561b07448bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2eabdfc-a29c-47e0-b35a-a78c0f8eedca', 'volume_name': 'volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb596a-18ac-443d-9571-70e11aa8cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb596a-18ac-443d-9571-70e11aa8cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f55dbf-7106-4488-bf5e-e5cacf106ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Volume d2eabdfc-a29c-47e0-b35a-a78c0f8eedca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca', 'volume_size': 1} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 1 in 1.034s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Downloaded image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 43bb4837-687e-44c1-a1b8-47fbac8699f9 successfully. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 for user f2a3b3a32afc4a088009e48e6aeed7a2 is deleted. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Marking volume 43bb4837-687e-44c1-a1b8-47fbac8699f9 as bootable. {{(pid=83211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Copying metadata from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 to 43bb4837-687e-44c1-a1b8-47fbac8699f9. {{(pid=83211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Creating volume glance metadata for volume 43bb4837-687e-44c1-a1b8-47fbac8699f9 backed by image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fe374e-f001-4f8d-9422-c86d6c2ab87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bb4837-687e-44c1-a1b8-47fbac8699f9', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55e9ae7-98a9-4592-91fa-0f6cceb38157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Volume volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 (43bb4837-687e-44c1-a1b8-47fbac8699f9): created successfully Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55e9ae7-98a9-4592-91fa-0f6cceb38157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Flow 'volume_create_manager' (9ebbe017-4068-4cfd-be0d-a57864b0df6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-663978d6-697f-45ce-8e61-3e04ee47c115 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Created volume successfully. Feb 27 02:05:52 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc" returned: 0 in 0.564s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f703cb9f-4689-40c6-9629-b849c963d07b,created_at=2026-02-27T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966364394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f703cb9f-4689-40c6-9629-b849c963d07b,host='devstack@QuobyteHD#QuobyteHD',id=d2eabdfc-a29c-47e0-b35a-a78c0f8eedca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:51Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa547570-e948-47b7-acff-8056f289ebf0),volume_type_id=aa547570-e948-47b7-acff-8056f289ebf0)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Creating volume d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:52 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3a0b84-8077-4324-8005-f3039129d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d189905-217d-4ebb-912d-c7626e8bc6bc', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca 1073741824 Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016447c1-2f26-4458-99a2-8708e8bfdff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Volume volume-7d189905-217d-4ebb-912d-c7626e8bc6bc (7d189905-217d-4ebb-912d-c7626e8bc6bc): created successfully Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016447c1-2f26-4458-99a2-8708e8bfdff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (058bf58a-75b8-401b-aeba-bde1d9024015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2f1b6c7e-5deb-4a1a-956c-51a95bec9513 tempest-GroupsTest-1439379381 None] Created volume successfully. Feb 27 02:05:52 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca 1073741824" returned: 0 in 0.783s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=106,cinder:INSERT=34,cinder:UPDATE=102,cinder:DELETE=1 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca Feb 27 02:05:52 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=88,cinder:SELECT=94,cinder:DELETE=8,cinder:INSERT=20 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Acquiring lock "cinder-quobyte-7d189905-217d-4ebb-912d-c7626e8bc6bc" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-7d189905-217d-4ebb-912d-c7626e8bc6bc" acquired by "delete_volume" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[315afb4c-0d60-46d2-a87d-a5bb39d5f30e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:53 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc Feb 27 02:05:53 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" returned: 0 in 0.765s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.283s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f55dbf-7106-4488-bf5e-e5cacf106ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3104931a-3383-4039-b52f-65d5a6c6dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76f2d7-78b9-4302-8fb1-16ad5b082ede]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Volume volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca (d2eabdfc-a29c-47e0-b35a-a78c0f8eedca): created successfully Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3104931a-3383-4039-b52f-65d5a6c6dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (aa8455c6-7f8a-441b-b8b7-796d29b8a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ff674e26-c2d1-4443-bbe7-d436aadc17a7 tempest-GroupSnapshotsTest-2064436582 None] Created volume successfully. Feb 27 02:05:54 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:54 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc" returned: 0 in 0.665s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc Feb 27 02:05:54 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 0.882s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d189905-217d-4ebb-912d-c7626e8bc6bc" returned: 0 in 0.584s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-7d189905-217d-4ebb-912d-c7626e8bc6bc" released by "delete_volume" :: held 1.296s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:54 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:05:54 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e48f10d4-73c6-49f6-b446-07e07825e7f3 tempest-GroupSnapshotsTest-2064436582 None] Update group completed successfully. Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Created reservations ['0e4bcd67-4a89-4cd6-b6e2-63fa3a8b0774'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:54 devstack cinder-volume[83211]: WARNING cinder.quota [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1683752585 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1683752585, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:54 devstack cinder-volume[83211]: WARNING cinder.quota [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1683752585 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1683752585, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Created reservations ['b4727770-2e20-4218-87d3-aa8637581fdf', '0efa357d-76a7-42e9-a614-bc6771535564', '04e2da2a-6ff1-409d-9d6f-2295c7486457', '8daaf5bc-d1cf-4d57-9a2e-33f892a09b1d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:54 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 1 in 0.851s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.804s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Flow 'volume_create_manager' (a532b9c4-a21b-473a-b885-81f3ceb278f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc2d98-1bde-4e17-8528-e05321f61cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc2d98-1bde-4e17-8528-e05321f61cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2053437304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9957a58f-a401-4e54-b68a-ac0b2816991b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198191404d2443e096680e52aa4d9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:56Z,use_quota=True,user_id='d60041c2ec844b42a78fbe9e38547aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e29f585-ab2c-4d21-bdd8-b9c63dbfc980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e29f585-ab2c-4d21-bdd8-b9c63dbfc980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41909954-2c98-407e-b001-4a845694c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41909954-2c98-407e-b001-4a845694c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9957a58f-a401-4e54-b68a-ac0b2816991b', 'volume_name': 'volume-9957a58f-a401-4e54-b68a-ac0b2816991b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7625db-c92a-400a-9be2-9725374a7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7625db-c92a-400a-9be2-9725374a7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb1266-d793-41c0-bf77-f9504cebc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Volume 9957a58f-a401-4e54-b68a-ac0b2816991b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9957a58f-a401-4e54-b68a-ac0b2816991b', 'volume_size': 1} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2053437304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9957a58f-a401-4e54-b68a-ac0b2816991b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198191404d2443e096680e52aa4d9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:56Z,use_quota=True,user_id='d60041c2ec844b42a78fbe9e38547aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Creating volume 9957a58f-a401-4e54-b68a-ac0b2816991b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:55 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9', 'name': 'volume-43bb4837-687e-44c1-a1b8-47fbac8699f9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5c26066-8228-4386-a49a-da40275ed79a', 'enforce_multipath': True} {{(pid=83211) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:05:55 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b 1073741824 Feb 27 02:05:55 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-643dcf79-7627-48d3-a5d0-d89ff4d5999c tempest-GroupSnapshotsTest-2064436582 None] Update group completed successfully. Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.771s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-48d6a8d3-e562-44d9-bdad-f242b9a0a02d tempest-GroupsTest-1439379381 None] Delete group completed successfully. Feb 27 02:05:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-09ef13fa-e927-4d00-8774-1d14562de848 req-9273b830-9e49-43ba-8f34-3ceaf8465285 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] attachment_update completed successfully. Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Created reservations ['0e85b29a-29f5-409e-a265-4c060d98929c'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:55 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b 1073741824" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b Feb 27 02:05:56 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-43107afc-8f0f-44ab-9b0b-80719de8ff55 tempest-GroupsTest-1439379381 None] Delete group completed successfully. Feb 27 02:05:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9ec4e439-7e7e-40ad-924f-504b9e4a35eb tempest-GroupSnapshotsTest-2064436582 None] Update group completed successfully. Feb 27 02:05:56 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b" returned: 0 in 0.539s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb1266-d793-41c0-bf77-f9504cebc9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9957a58f-a401-4e54-b68a-ac0b2816991b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58847e1f-b3c9-4511-9345-952d340f248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Volume volume-9957a58f-a401-4e54-b68a-ac0b2816991b (9957a58f-a401-4e54-b68a-ac0b2816991b): created successfully Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58847e1f-b3c9-4511-9345-952d340f248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Flow 'volume_create_manager' (a532b9c4-a21b-473a-b885-81f3ceb278f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a448ae00-34ee-4e6d-8e58-781e56fec32b tempest-VolumeQuotasNegativeTestJSON-974133793 None] Created volume successfully. Feb 27 02:05:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a4677498-ed55-4b50-938f-cb894aaf51ec tempest-GroupsTest-1439379381 None] Group tempest-GroupsTest-Group-22158022: creating Feb 27 02:05:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a4677498-ed55-4b50-938f-cb894aaf51ec tempest-GroupsTest-1439379381 None] Group tempest-GroupsTest-Group-22158022: created successfully Feb 27 02:05:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a4677498-ed55-4b50-938f-cb894aaf51ec tempest-GroupsTest-1439379381 None] Create group completed successfully. Feb 27 02:05:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-df18d1ce-a75a-4b25-b7f9-9c6a4e12bded tempest-GroupSnapshotsTest-2064436582 None] Update group completed successfully. Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Acquiring lock "cinder-9957a58f-a401-4e54-b68a-ac0b2816991b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "cinder-9957a58f-a401-4e54-b68a-ac0b2816991b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Acquiring lock "cinder-quobyte-9957a58f-a401-4e54-b68a-ac0b2816991b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "cinder-quobyte-9957a58f-a401-4e54-b68a-ac0b2816991b" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f270b4-0743-47b4-aba6-af7fe8e537e0]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b Feb 27 02:05:58 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (5258f829-308e-4d69-93b9-ee5c936334e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd2a13e-6106-4aad-8be8-0be187d11b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd2a13e-6106-4aad-8be8-0be187d11b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402424439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,host='devstack@QuobyteHD#QuobyteHD',id=aa9e18a1-80c5-4a14-9b99-9ffb949a19f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:58Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a8638dd-e3ce-44b4-b2bc-3194b60c1998),volume_type_id=3a8638dd-e3ce-44b4-b2bc-3194b60c1998)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deebc37d-c978-41dd-8c40-6b2165ffdbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deebc37d-c978-41dd-8c40-6b2165ffdbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5f52fd-544c-4f92-a702-a6902636462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5f52fd-544c-4f92-a702-a6902636462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9e18a1-80c5-4a14-9b99-9ffb949a19f9', 'volume_name': 'volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb680120-9bcc-493e-a4f3-25e60629b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb680120-9bcc-493e-a4f3-25e60629b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec64ab7-4d07-4623-95ac-c6e356ef7b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:58 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Volume aa9e18a1-80c5-4a14-9b99-9ffb949a19f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9', 'volume_size': 1} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,created_at=2026-02-27T01:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1402424439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,host='devstack@QuobyteHD#QuobyteHD',id=aa9e18a1-80c5-4a14-9b99-9ffb949a19f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:58Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a8638dd-e3ce-44b4-b2bc-3194b60c1998),volume_type_id=3a8638dd-e3ce-44b4-b2bc-3194b60c1998)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Creating volume aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:58 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:05:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 1073741824 Feb 27 02:05:58 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b" returned: 0 in 0.620s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b Feb 27 02:05:59 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] GroupSnapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: creating. Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Group snapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: creating. {{(pid=83211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:59 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 1073741824" returned: 0 in 0.663s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 Feb 27 02:05:59 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9957a58f-a401-4e54-b68a-ac0b2816991b" returned: 0 in 0.513s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "cinder-quobyte-9957a58f-a401-4e54-b68a-ac0b2816991b" released by "delete_volume" :: held 1.161s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Created reservations ['e0e0c5b1-4bb9-4289-94a0-aa01cb45b0e4', 'e94db9dc-3e70-4179-83c4-fff7ad18bc5d', '54177933-4a38-4af3-b072-1475221fd283', '12ad7dd2-7777-4449-8ad4-caf4a5a737b6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:05:59 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" returned: 0 in 0.490s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.551s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Creating offline snapshot 7df40ac9-19f6-414a-ba3c-958944f9c6ef of volume d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec64ab7-4d07-4623-95ac-c6e356ef7b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f326134b-96d5-42f5-9e62-ee0050fcb397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bd16a-be65-49b8-95bf-03fc92588fb5]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Volume volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 (aa9e18a1-80c5-4a14-9b99-9ffb949a19f9): created successfully Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f326134b-96d5-42f5-9e62-ee0050fcb397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (5258f829-308e-4d69-93b9-ee5c936334e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-364ea84e-ff3a-45f6-9d1e-f20b4d91ef07 tempest-GroupsTest-1439379381 None] Created volume successfully. Feb 27 02:05:59 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca Feb 27 02:05:59 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.539s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:00 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Deleted volume successfully. Feb 27 02:06:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-36ed32e6-a1e7-4873-8e30-4a5dbba5b740 tempest-VolumeQuotasNegativeTestJSON-974133793 None] Lock "cinder-9957a58f-a401-4e54-b68a-ac0b2816991b-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:00 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" returned: 0 in 0.786s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef 1G Feb 27 02:06:00 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (9de44613-eb2f-4b75-920c-17733c767adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aac87f2-367d-480d-ad6e-4f896626179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aac87f2-367d-480d-ad6e-4f896626179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260577039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,host='devstack@QuobyteHD#QuobyteHD',id=8eb56129-f8d9-4b1c-ad8e-c36d4013db9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:02Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a8638dd-e3ce-44b4-b2bc-3194b60c1998),volume_type_id=3a8638dd-e3ce-44b4-b2bc-3194b60c1998)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb637a0-b8f4-4339-8069-f4797df2bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb637a0-b8f4-4339-8069-f4797df2bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045c18ca-d3ae-48ee-b979-bba0b5d6b111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045c18ca-d3ae-48ee-b979-bba0b5d6b111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb56129-f8d9-4b1c-ad8e-c36d4013db9c', 'volume_name': 'volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0e4f22-9341-48ca-b061-4381b5da67b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0e4f22-9341-48ca-b061-4381b5da67b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c6cd9-8b5e-43be-92c0-3d97b9654df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Volume 8eb56129-f8d9-4b1c-ad8e-c36d4013db9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c', 'volume_size': 1} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:01 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef 1G" returned: 0 in 1.321s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef Feb 27 02:06:01 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef" returned: 0 in 0.731s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef Feb 27 02:06:02 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef" returned: 0 in 0.895s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info Feb 27 02:06:03 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info" returned: 0 in 0.843s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info Feb 27 02:06:04 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.info" returned: 0 in 0.771s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.437s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Creating offline snapshot 8f547465-2c76-4865-8427-726e982b2661 of volume f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab229a-8c1c-45d7-8166-304202c30333]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 Feb 27 02:06:05 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7" returned: 0 in 0.668s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 1G Feb 27 02:06:05 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 1G" returned: 0 in 0.786s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 Feb 27 02:06:06 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Flow 'volume_create_manager' (eea36a54-88e3-475b-949f-f080ac8cb53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13879fc-0d0f-4ef5-ab0b-2f867632b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13879fc-0d0f-4ef5-ab0b-2f867632b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-887997602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86d27d8-fc4a-4268-8dc2-4d1b676ee527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf022451f96a4e4695ae3ee9efaf1ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='e290cb9d1d044ccb81de7b27e41713a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc245a76-de15-4776-babe-29dbc6f3a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc245a76-de15-4776-babe-29dbc6f3a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ad5eaa-5ed7-49fd-945d-83b35474389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ad5eaa-5ed7-49fd-945d-83b35474389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86d27d8-fc4a-4268-8dc2-4d1b676ee527', 'volume_name': 'volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc3d79a-8d81-4443-b953-d1def89629b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc3d79a-8d81-4443-b953-d1def89629b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc063078-a0e7-4e98-b71f-4347b8639ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Volume f86d27d8-fc4a-4268-8dc2-4d1b676ee527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527', 'volume_size': 1} Feb 27 02:06:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661" returned: 0 in 0.527s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 Feb 27 02:06:07 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661" returned: 0 in 0.501s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info Feb 27 02:06:07 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info" returned: 0 in 0.470s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info Feb 27 02:06:08 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.info" returned: 0 in 0.567s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.601s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.047s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,created_at=2026-02-27T01:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260577039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9546d7d4-a3b4-4a09-8662-fcf8d8b80d60,host='devstack@QuobyteHD#QuobyteHD',id=8eb56129-f8d9-4b1c-ad8e-c36d4013db9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4282cd9c03224afa83b8d9b158307722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:02Z,use_quota=True,user_id='7e737fbb66f8457198ef917c2e0109fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a8638dd-e3ce-44b4-b2bc-3194b60c1998),volume_type_id=3a8638dd-e3ce-44b4-b2bc-3194b60c1998)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Creating volume 8eb56129-f8d9-4b1c-ad8e-c36d4013db9c {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:08 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c 1073741824 Feb 27 02:06:08 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a03ddd81-300e-4d30-be11-635147cb958d tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: created successfully Feb 27 02:06:09 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c 1073741824" returned: 0 in 0.656s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c Feb 27 02:06:09 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: deleting Feb 27 02:06:09 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: deleting {{(pid=83211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:06:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-7df40ac9-19f6-414a-ba3c-958944f9c6ef" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-7df40ac9-19f6-414a-ba3c-958944f9c6ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Deleting offline snapshot 7df40ac9-19f6-414a-ba3c-958944f9c6ef of volume d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] snapshot_file for this snap is: volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[451206da-2e98-40ee-a7b5-0be44ece5d70]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" returned: 0 in 0.570s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.236s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-887997602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86d27d8-fc4a-4268-8dc2-4d1b676ee527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf022451f96a4e4695ae3ee9efaf1ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='e290cb9d1d044ccb81de7b27e41713a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Creating volume f86d27d8-fc4a-4268-8dc2-4d1b676ee527 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:10 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c6cd9-8b5e-43be-92c0-3d97b9654df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28502c4-d2d5-49b2-82bb-32abb9d0a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:10 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 1073741824 Feb 27 02:06:10 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Volume volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c (8eb56129-f8d9-4b1c-ad8e-c36d4013db9c): created successfully Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28502c4-d2d5-49b2-82bb-32abb9d0a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Flow 'volume_create_manager' (9de44613-eb2f-4b75-920c-17733c767adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:10 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef Feb 27 02:06:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4c6a07c1-3260-472e-ba77-a3134220e46a tempest-GroupsTest-1439379381 None] Created volume successfully. Feb 27 02:06:10 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fb95d76e-2729-47ea-bb57-6d806d065c76 tempest-GroupsTest-1439379381 None] Update group completed successfully. Feb 27 02:06:10 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef" returned: 0 in 0.645s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c188c-6da1-4c68-af70-22e936f5204d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 1073741824" returned: 0 in 0.686s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca Feb 27 02:06:10 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 Feb 27 02:06:10 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" returned: 0 in 0.496s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef Feb 27 02:06:11 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" returned: 0 in 0.464s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc063078-a0e7-4e98-b71f-4347b8639ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c48e227-2c38-4505-a990-f19c432c4cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Volume volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 (f86d27d8-fc4a-4268-8dc2-4d1b676ee527): created successfully Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c48e227-2c38-4505-a990-f19c432c4cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Flow 'volume_create_manager' (eea36a54-88e3-475b-949f-f080ac8cb53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d1aee8f3-41f2-4775-a0bb-8a433cb63ca6 tempest-VolumesServicesTestJSON-235490037 None] Created volume successfully. Feb 27 02:06:11 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef" returned: 0 in 0.529s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef Feb 27 02:06:11 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6f7b42ad-8bea-4b46-84c6-3dc46da96ebe tempest-GroupsTest-1439379381 None] Update group completed successfully. Feb 27 02:06:12 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca.7df40ac9-19f6-414a-ba3c-958944f9c6ef" returned: 0 in 0.462s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-7df40ac9-19f6-414a-ba3c-958944f9c6ef" released by "_delete_snapshot" :: held 2.205s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" released by "delete_snapshot" :: held 2.227s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-8f547465-2c76-4865-8427-726e982b2661" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-8f547465-2c76-4865-8427-726e982b2661" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Deleting offline snapshot 8f547465-2c76-4865-8427-726e982b2661 of volume f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] snapshot_file for this snap is: volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b9249a-ca3d-4621-820e-a9378bc0b81f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Acquiring lock "cinder-f86d27d8-fc4a-4268-8dc2-4d1b676ee527-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "cinder-f86d27d8-fc4a-4268-8dc2-4d1b676ee527-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Acquiring lock "cinder-quobyte-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "cinder-quobyte-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ed7f6-8aaa-4587-80d4-ea1add192224]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 Feb 27 02:06:12 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 Feb 27 02:06:12 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661" returned: 0 in 0.647s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f350336b-0b77-47c9-9510-fa6179b0e2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a6ee7-8c8b-4afd-9301-0db2c12afd62]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" returned: 0 in 0.589s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527 Feb 27 02:06:13 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 Feb 27 02:06:13 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Acquiring lock "cinder-quobyte-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa59920-4b8e-42d8-95a3-93597b09c0be]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c Feb 27 02:06:13 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" returned: 0 in 0.509s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:13 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "cinder-quobyte-f86d27d8-fc4a-4268-8dc2-4d1b676ee527" released by "delete_volume" :: held 1.133s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Created reservations ['cd0b7bb0-2e79-4fef-ba83-2f5568bf45b2', 'f6e35cf4-bf06-4218-9965-c76b54e226b1', '66ae68ad-e738-444c-b6be-dc26638bd379', '5f4c61d1-422f-427b-aed3-0feea5045218'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:13 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7" returned: 0 in 0.610s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 Feb 27 02:06:13 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:13 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" returned: 0 in 0.605s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c Feb 27 02:06:13 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.504s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:14 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.502s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:14 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Deleted volume successfully. Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a1872b24-171a-47d4-be10-d383e9c1643a tempest-VolumesServicesTestJSON-235490037 None] Lock "cinder-f86d27d8-fc4a-4268-8dc2-4d1b676ee527-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:14 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661 Feb 27 02:06:14 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" returned: 0 in 0.520s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-8eb56129-f8d9-4b1c-ad8e-c36d4013db9c" released by "delete_volume" :: held 1.160s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Acquiring lock "cinder-quobyte-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1544e06-f250-487a-88a4-46dae3fb0e8d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 Feb 27 02:06:14 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7.8f547465-2c76-4865-8427-726e982b2661" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-8f547465-2c76-4865-8427-726e982b2661" released by "_delete_snapshot" :: held 2.505s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" released by "delete_snapshot" :: held 2.525s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:14 devstack cinder-volume[83211]: WARNING cinder.quota [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1856109767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1856109767, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:14 devstack cinder-volume[83211]: WARNING cinder.quota [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1856109767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1856109767, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:14 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['a2c6b7ef-10b9-4c77-a89e-58047811594b', '47ae7cba-ac8b-4806-aa52-4affebf18c1a', 'bba1cd46-bb0e-4e9e-972f-27a5878796b4', '396e9abf-d496-4f0e-9414-8e45ccc55ffa'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:15 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['a508d1e6-73d4-4745-901e-62d42eac1d97', '7675c13f-243b-4e06-a00e-2d88157c0284', '2bb3547b-738a-456c-ba6f-d780f30d828f', '763db82a-883a-4844-ae74-856850dfbf23'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:15 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" returned: 0 in 0.689s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:15 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9 Feb 27 02:06:15 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3dc7b570-b6c4-4249-8d46-ca866b8abf79 tempest-GroupSnapshotsTest-2064436582 None] group_snapshot 2cb98b4e-0a22-45d1-9641-9be9936c17e4: deleted successfully Feb 27 02:06:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" acquired by "delete_volume" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d432f-95b3-47ba-a874-cdc2dd66b5bf]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" returned: 0 in 1.119s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "cinder-quobyte-aa9e18a1-80c5-4a14-9b99-9ffb949a19f9" released by "delete_volume" :: held 1.838s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:16 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca Feb 27 02:06:16 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Created reservations ['8c0d44a7-e8be-4387-ba2f-bfbf881d0fb2'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:16 devstack cinder-volume[83211]: WARNING cinder.quota [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-960918395 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-960918395, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:16 devstack cinder-volume[83211]: WARNING cinder.quota [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-960918395 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-960918395, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Created reservations ['c7237ebd-8953-42d4-a552-01924707feb5', 'b42d03d5-aef9-40a9-b74c-7098a9e5a7a1', 'cc61c2be-1faa-4e8e-a0af-4c9d19dfdbaf', '5dee5f44-66e3-42a4-a24a-fc577a15ba79'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Created reservations ['4bf927a6-b996-4afb-b3ce-8a1ce0935d5d', 'fcddf274-9a41-4ac2-8bd3-c2028735c20e', 'a2581eb5-98d2-4fa2-afec-5a0a5cfb588d', 'e5d3e45a-8e15-47bd-be23-b36f8fd9f636'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:16 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" returned: 0 in 0.996s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:17 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca Feb 27 02:06:17 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.785s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e5aa893f-6890-42df-a057-1fb60eab399b tempest-GroupsTest-1439379381 None] Delete group completed successfully. Feb 27 02:06:17 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" returned: 0 in 0.906s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-d2eabdfc-a29c-47e0-b35a-a78c0f8eedca" released by "delete_volume" :: held 2.024s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a6a94-094b-4626-959a-43a87074cf3c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 Feb 27 02:06:18 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:18 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7" returned: 0 in 0.819s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7 Feb 27 02:06:18 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f350336b-0b77-47c9-9510-fa6179b0e2a7" returned: 0 in 0.783s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-f350336b-0b77-47c9-9510-fa6179b0e2a7" released by "delete_volume" :: held 1.656s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['b2cd0eca-5f4a-4f8f-84bb-f8d868fc05b1'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:19 devstack cinder-volume[83211]: WARNING cinder.quota [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1856109767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1856109767, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['757fec5b-29e6-493b-a2f9-d20f1390e101', '602a6ab8-c6aa-4042-9729-70f19b7770db', 'b8cf2b2b-f26b-4d08-a314-c54b5836549f', '75e1c1ec-5317-4c4d-8a83-19fb0ab532cc'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['060445f3-6e45-4f75-aabe-697b0bb49ced', '31b7ac5d-054d-4d76-8c1d-ae15e11bbddc', '676f0e94-469b-4dfa-ad53-46d09251ccff', '71755d8e-4153-457e-8633-723876bc0cad'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:20 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.805s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d647aead-ad94-482b-945c-01dc8b3d411e tempest-GroupSnapshotsTest-2064436582 None] Delete group completed successfully. Feb 27 02:06:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3b7b43bb-4a2f-4385-a9ec-e66ce4c6c752 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-145778564: creating Feb 27 02:06:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3b7b43bb-4a2f-4385-a9ec-e66ce4c6c752 tempest-GroupSnapshotsTest-2064436582 None] Group tempest-GroupSnapshotsTest-Group-145778564: created successfully Feb 27 02:06:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3b7b43bb-4a2f-4385-a9ec-e66ce4c6c752 tempest-GroupSnapshotsTest-2064436582 None] Create group completed successfully. Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (57a8df0f-3838-4b2c-a80d-675dde4b429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97bea51-0243-4c75-bb9c-f539c686f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97bea51-0243-4c75-bb9c-f539c686f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960094353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be29965-3200-43d2-a347-47a4ff9a146c,host='devstack@QuobyteHD#QuobyteHD',id=0b7b3ce4-014b-41ad-9b80-a46937a80487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b7f8a00-e272-46fe-8905-7987a5c0d9f7),volume_type_id=3b7f8a00-e272-46fe-8905-7987a5c0d9f7)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a1c91-52b7-4546-8a77-17f6851fbf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a1c91-52b7-4546-8a77-17f6851fbf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1f886-f0b4-4dcb-a890-049c5ce3fb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c1f886-f0b4-4dcb-a890-049c5ce3fb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7b3ce4-014b-41ad-9b80-a46937a80487', 'volume_name': 'volume-0b7b3ce4-014b-41ad-9b80-a46937a80487', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c24e38-357a-4bc1-be78-25b8fc269003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c24e38-357a-4bc1-be78-25b8fc269003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83df914-74ea-4717-a6c4-811d5c039eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Volume 0b7b3ce4-014b-41ad-9b80-a46937a80487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7b3ce4-014b-41ad-9b80-a46937a80487', 'volume_size': 1} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2be29965-3200-43d2-a347-47a4ff9a146c,created_at=2026-02-27T01:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960094353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be29965-3200-43d2-a347-47a4ff9a146c,host='devstack@QuobyteHD#QuobyteHD',id=0b7b3ce4-014b-41ad-9b80-a46937a80487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a979208b64369ae6afdea8bf9ff57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='8918aafec56147d1a5f609e2c386d643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b7f8a00-e272-46fe-8905-7987a5c0d9f7),volume_type_id=3b7f8a00-e272-46fe-8905-7987a5c0d9f7)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Creating volume 0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:22 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 1073741824 Feb 27 02:06:22 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 1073741824" returned: 0 in 0.897s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 Feb 27 02:06:23 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487" returned: 0 in 0.756s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83df914-74ea-4717-a6c4-811d5c039eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7b3ce4-014b-41ad-9b80-a46937a80487', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1b81b3-3e7c-49f9-b85b-aa1f458e5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:24 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Volume volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 (0b7b3ce4-014b-41ad-9b80-a46937a80487): created successfully Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1b81b3-3e7c-49f9-b85b-aa1f458e5023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Flow 'volume_create_manager' (57a8df0f-3838-4b2c-a80d-675dde4b429d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:24 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-57e046d0-609a-4717-bb33-1eb8718ae26c tempest-GroupSnapshotsTest-2064436582 None] Created volume successfully. Feb 27 02:06:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] GroupSnapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: creating. Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Group snapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: creating. {{(pid=83211) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Creating offline snapshot 23fd832c-f268-400c-8a83-a7c567825794 of volume 0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3214b-0c39-4fdd-8a56-62ebb178e6eb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:25 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 Feb 27 02:06:25 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (e96ab16f-cd39-4e1e-8d1b-570d1d7113c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8238ef9-d673-4a9d-a0c4-165edd0ac645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8238ef9-d673-4a9d-a0c4-165edd0ac645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2027316606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161d10eb-ed99-4e27-aeef-24a1d3395056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:26Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4072b443-9fa2-426b-823f-e14cbf9d8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4072b443-9fa2-426b-823f-e14cbf9d8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ed13de-e0f7-4bf2-b851-4bda2876016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ed13de-e0f7-4bf2-b851-4bda2876016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161d10eb-ed99-4e27-aeef-24a1d3395056', 'volume_name': 'volume-161d10eb-ed99-4e27-aeef-24a1d3395056', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3852a4-8aeb-4a6b-aa54-745709c14fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3852a4-8aeb-4a6b-aa54-745709c14fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deb407f-fe07-4dfa-898c-1bd84a391790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Volume 161d10eb-ed99-4e27-aeef-24a1d3395056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161d10eb-ed99-4e27-aeef-24a1d3395056', 'volume_size': 1} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:26 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487" returned: 0 in 0.614s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 1G Feb 27 02:06:26 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 1G" returned: 0 in 0.623s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 Feb 27 02:06:26 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794" returned: 0 in 0.571s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 Feb 27 02:06:27 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794" returned: 0 in 0.506s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info Feb 27 02:06:27 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-6a4f7ed4-9830-4f22-aef1-e0c4d62f56d7 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Terminate volume connection completed successfully. Feb 27 02:06:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-6a4f7ed4-9830-4f22-aef1-e0c4d62f56d7 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Deleting attachment b5c26066-8228-4386-a49a-da40275ed79a. {{(pid=83211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:06:28 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info" returned: 0 in 0.555s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info Feb 27 02:06:28 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "cinder-43bb4837-687e-44c1-a1b8-47fbac8699f9-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-43bb4837-687e-44c1-a1b8-47fbac8699f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "cinder-quobyte-43bb4837-687e-44c1-a1b8-47fbac8699f9" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-quobyte-43bb4837-687e-44c1-a1b8-47fbac8699f9" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34720b52-d5fe-4b13-ab17-621dde35b5e6]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:06:28 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.info" returned: 0 in 0.618s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.575s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.944s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2027316606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161d10eb-ed99-4e27-aeef-24a1d3395056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:26Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Creating volume 161d10eb-ed99-4e27-aeef-24a1d3395056 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:29 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 1073741824 Feb 27 02:06:29 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ec9f8e3f-d53f-4f73-8579-6bb553dcd8d5 tempest-GroupSnapshotsTest-2064436582 None] group_snapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: created successfully Feb 27 02:06:29 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 0.725s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:06:29 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] group_snapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: deleting Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] group_snapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: deleting {{(pid=83211) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-23fd832c-f268-400c-8a83-a7c567825794" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-23fd832c-f268-400c-8a83-a7c567825794" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Deleting offline snapshot 23fd832c-f268-400c-8a83-a7c567825794 of volume 0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:29 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] snapshot_file for this snap is: volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 1073741824" returned: 0 in 0.870s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce68b46a-0ba5-4e31-b301-f28d18cfb466]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 Feb 27 02:06:29 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 Feb 27 02:06:30 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 1 in 0.703s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9 Feb 27 02:06:30 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056" returned: 0 in 0.648s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deb407f-fe07-4dfa-898c-1bd84a391790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161d10eb-ed99-4e27-aeef-24a1d3395056', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce4f3f4-4afe-4d6b-98ca-4e01d2be895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Volume volume-161d10eb-ed99-4e27-aeef-24a1d3395056 (161d10eb-ed99-4e27-aeef-24a1d3395056): created successfully Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce4f3f4-4afe-4d6b-98ca-4e01d2be895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (e96ab16f-cd39-4e1e-8d1b-570d1d7113c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794" returned: 0 in 0.735s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b7b3ce4-014b-41ad-9b80-a46937a80487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e6ecaa1f-0cc4-40e2-ac33-9b2af644f02e tempest-VolumesListAdminTestJSON-9043886 None] Created volume successfully. Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a20724a-e7ef-40e6-a99e-574327135c4c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-43bb4837-687e-44c1-a1b8-47fbac8699f9" returned: 0 in 0.593s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-quobyte-43bb4837-687e-44c1-a1b8-47fbac8699f9" released by "delete_volume" :: held 2.074s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:30 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 Feb 27 02:06:30 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.quota [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Created reservations ['69834833-5528-4308-aeeb-9897399496fa', '78c52ed2-d270-40ce-8bae-9ba5029b10fd', '9cbcf049-6833-4597-a610-2b07357844b8', 'c8c7c059-60c0-44fc-8a7d-15996a7b23d5'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:30 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487" returned: 0 in 0.599s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 Feb 27 02:06:31 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.559s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.manager [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:31 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Deleted volume successfully. Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-1c7f9185-661d-418a-9fa2-3e622f909e84 req-ea7d5d4a-7015-47f0-ac2c-2b6066e35b27 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-43bb4837-687e-44c1-a1b8-47fbac8699f9-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (fb73552e-f643-4441-af3c-ad2da82f0678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc47860-a41c-492b-b648-63321c077b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc47860-a41c-492b-b648-63321c077b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162812355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44280bac-eae5-45db-abb6-413e32f031d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d325a837-12da-4f96-bf1f-0a733bc39efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d325a837-12da-4f96-bf1f-0a733bc39efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffaca2e-81bb-4157-8244-65a161534fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffaca2e-81bb-4157-8244-65a161534fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44280bac-eae5-45db-abb6-413e32f031d3', 'volume_name': 'volume-44280bac-eae5-45db-abb6-413e32f031d3', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6022b-ce76-44f4-9a8c-5fc363bce884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6022b-ce76-44f4-9a8c-5fc363bce884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dfb829-aabc-4415-b41d-bdcf75186227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Volume 44280bac-eae5-45db-abb6-413e32f031d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44280bac-eae5-45db-abb6-413e32f031d3', 'volume_size': 1} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162812355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44280bac-eae5-45db-abb6-413e32f031d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Creating volume 44280bac-eae5-45db-abb6-413e32f031d3 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:32 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794" returned: 0 in 0.785s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794 Feb 27 02:06:32 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 1073741824 Feb 27 02:06:32 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487.23fd832c-f268-400c-8a83-a7c567825794" returned: 0 in 0.651s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-23fd832c-f268-400c-8a83-a7c567825794" released by "_delete_snapshot" :: held 2.853s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:32 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 1073741824" returned: 0 in 0.683s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" released by "delete_snapshot" :: held 2.883s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 Feb 27 02:06:32 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack cinder-volume[83211]: WARNING cinder.quota [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-478265575 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-478265575, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:32 devstack cinder-volume[83211]: WARNING cinder.quota [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-478265575 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-478265575, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:32 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['3de27136-2f3d-4a9b-91cc-dc96b2a5d211', 'f8b1d11a-efb6-44a8-81a6-5cc900dadc87', 'aa2f9019-5fe2-4d9b-8b54-fce20629faa6', '7c15b627-7516-4280-affe-10b126df6d39'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:32 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-76b15864-7708-4db6-b8e1-d0a62b9a63df tempest-GroupSnapshotsTest-2064436582 None] group_snapshot ba4f9367-7e2b-46a0-b37d-7108c9d7d583: deleted successfully Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[872123ce-0e15-4487-82d0-3ceb944ebb27]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3" returned: 0 in 0.668s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dfb829-aabc-4415-b41d-bdcf75186227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44280bac-eae5-45db-abb6-413e32f031d3', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a62a751-9bfe-48fc-9adc-36f0f146b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Volume volume-44280bac-eae5-45db-abb6-413e32f031d3 (44280bac-eae5-45db-abb6-413e32f031d3): created successfully Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a62a751-9bfe-48fc-9adc-36f0f146b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (fb73552e-f643-4441-af3c-ad2da82f0678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4ace89aa-f444-47ac-9c15-5c9c850c2268 tempest-VolumesListAdminTestJSON-9043886 None] Created volume successfully. Feb 27 02:06:33 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 Feb 27 02:06:33 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487" returned: 0 in 0.619s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487 Feb 27 02:06:34 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (966f86c2-2ef2-4989-971c-52d3b95f86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc7850a-7147-4eac-a9dc-6c4161db459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc7850a-7147-4eac-a9dc-6c4161db459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-498218984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4987e2-d913-43d1-8a80-000caa4a868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:34Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa3010-841c-4349-8be7-baf489537f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa3010-841c-4349-8be7-baf489537f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd794879-785c-469a-83ad-8a27e910ca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd794879-785c-469a-83ad-8a27e910ca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4987e2-d913-43d1-8a80-000caa4a868a', 'volume_name': 'volume-ce4987e2-d913-43d1-8a80-000caa4a868a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a61062-42ee-42dc-a59a-a72eea3dbde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a61062-42ee-42dc-a59a-a72eea3dbde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f87272-2c45-4c9c-949c-84d9edaa2698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:34 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Volume ce4987e2-d913-43d1-8a80-000caa4a868a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4987e2-d913-43d1-8a80-000caa4a868a', 'volume_size': 1} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-498218984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4987e2-d913-43d1-8a80-000caa4a868a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24899179d90f4b7fb171b5c015b99e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:34Z,use_quota=True,user_id='e03f6fb9b44f418cb5a6810f21f4afd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Creating volume ce4987e2-d913-43d1-8a80-000caa4a868a {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:34 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a 1073741824 Feb 27 02:06:34 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0b7b3ce4-014b-41ad-9b80-a46937a80487" returned: 0 in 0.479s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Lock "cinder-quobyte-0b7b3ce4-014b-41ad-9b80-a46937a80487" released by "delete_volume" :: held 1.148s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['4b206b88-d931-4b21-a3ac-c9f722336624'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:34 devstack cinder-volume[83211]: WARNING cinder.quota [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-478265575 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-478265575, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Created reservations ['12e6e529-0c13-40ec-aa5d-a2983c319f6f', 'e0dc2aa3-8c01-4a1d-873b-aee681c61f66', 'fb34fd35-fc01-4f5f-99e4-6390171b83bd', '4ee4b1df-9d09-40c0-a03c-faa41fa67175'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[86256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:34 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a 1073741824" returned: 0 in 0.687s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a Feb 27 02:06:35 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.587s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fcd4a61b-d6b1-4fa9-96c0-df0660d8a306 tempest-GroupSnapshotsTest-2064436582 None] Delete group completed successfully. Feb 27 02:06:35 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a" returned: 0 in 0.557s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f87272-2c45-4c9c-949c-84d9edaa2698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4987e2-d913-43d1-8a80-000caa4a868a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73985eb2-c98f-4fe2-a4f8-d72d567ef058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:35 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Volume volume-ce4987e2-d913-43d1-8a80-000caa4a868a (ce4987e2-d913-43d1-8a80-000caa4a868a): created successfully Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73985eb2-c98f-4fe2-a4f8-d72d567ef058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Flow 'volume_create_manager' (966f86c2-2ef2-4989-971c-52d3b95f86bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4e419c9a-9f21-406e-a83d-4a031b1cfcc0 tempest-VolumesListAdminTestJSON-9043886 None] Created volume successfully. Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Flow 'volume_create_manager' (8cad5bcb-1c12-49c0-a622-42df626e4ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1849e5a-89b3-4883-bff2-50b7e43f6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1849e5a-89b3-4883-bff2-50b7e43f6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9928d326-f277-4c69-86b5-59b91ca03d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8cf11d3ccb40d19ac987b2b6f314ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:37Z,use_quota=True,user_id='1ba6aaf6cd06417ab865ef742d9cb20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42981acd-3c4c-4e17-9001-c3f76db07745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42981acd-3c4c-4e17-9001-c3f76db07745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a59a782-0c4d-40f3-951e-4a3220544300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a59a782-0c4d-40f3-951e-4a3220544300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9928d326-f277-4c69-86b5-59b91ca03d86', 'volume_name': 'volume-9928d326-f277-4c69-86b5-59b91ca03d86', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a0b731-30c0-4394-82df-553315a824aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a0b731-30c0-4394-82df-553315a824aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc7a559-e311-4580-95ec-0c7fe97cc884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:37 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Volume 9928d326-f277-4c69-86b5-59b91ca03d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9928d326-f277-4c69-86b5-59b91ca03d86', 'volume_size': 1} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9928d326-f277-4c69-86b5-59b91ca03d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8cf11d3ccb40d19ac987b2b6f314ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:37Z,use_quota=True,user_id='1ba6aaf6cd06417ab865ef742d9cb20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Creating volume 9928d326-f277-4c69-86b5-59b91ca03d86 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:37 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:37 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 1073741824 Feb 27 02:06:37 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 1073741824" returned: 0 in 0.886s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:38 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 Feb 27 02:06:38 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86" returned: 0 in 0.640s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc7a559-e311-4580-95ec-0c7fe97cc884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9928d326-f277-4c69-86b5-59b91ca03d86', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfac2ae-dd91-4cb6-9f7d-78b415c29eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:39 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Volume volume-9928d326-f277-4c69-86b5-59b91ca03d86 (9928d326-f277-4c69-86b5-59b91ca03d86): created successfully Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfac2ae-dd91-4cb6-9f7d-78b415c29eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Flow 'volume_create_manager' (8cad5bcb-1c12-49c0-a622-42df626e4ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:39 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-88851d8c-648f-4a81-9c05-8a7033986413 tempest-VolumesListAdminTestJSON-366626650 None] Created volume successfully. Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Acquiring lock "cinder-9928d326-f277-4c69-86b5-59b91ca03d86-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "cinder-9928d326-f277-4c69-86b5-59b91ca03d86-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Acquiring lock "cinder-quobyte-9928d326-f277-4c69-86b5-59b91ca03d86" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "cinder-quobyte-9928d326-f277-4c69-86b5-59b91ca03d86" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b421326-8909-4dee-815a-c6ada12e2939]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-ce4987e2-d913-43d1-8a80-000caa4a868a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-ce4987e2-d913-43d1-8a80-000caa4a868a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-quobyte-ce4987e2-d913-43d1-8a80-000caa4a868a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:39 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 Feb 27 02:06:39 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-ce4987e2-d913-43d1-8a80-000caa4a868a" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[368469ad-b03c-4462-98bf-718e128f4d19]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a Feb 27 02:06:40 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d09c530a-2d24-4f8e-b50e-c5dba5d21280 tempest-GroupsV320Test-1826843317 None] Group tempest-GroupsV320Test-Group-1826122629: creating Feb 27 02:06:40 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d09c530a-2d24-4f8e-b50e-c5dba5d21280 tempest-GroupsV320Test-1826843317 None] Group tempest-GroupsV320Test-Group-1826122629: created successfully Feb 27 02:06:40 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d09c530a-2d24-4f8e-b50e-c5dba5d21280 tempest-GroupsV320Test-1826843317 None] Create group completed successfully. Feb 27 02:06:40 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86" returned: 0 in 0.782s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86 Feb 27 02:06:40 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a" returned: 0 in 0.809s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a Feb 27 02:06:40 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Flow 'volume_create_manager' (cffa0a6c-fe78-4260-89f3-e9dfc02720bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6c8f7b-da9e-446a-8b4c-ea5a1ba78cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6c8f7b-da9e-446a-8b4c-ea5a1ba78cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-192135464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92af02b5-f635-42ea-ab66-f73b8b79e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3c55ce7ae4cb292df0906248a5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:41Z,use_quota=True,user_id='6611ee0f506a48d1bcef594fa3e482f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a6189e-6ea9-4b47-8e2d-3806db64edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a6189e-6ea9-4b47-8e2d-3806db64edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac67c529-9c29-4dc3-8b1a-58fd9291d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac67c529-9c29-4dc3-8b1a-58fd9291d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92af02b5-f635-42ea-ab66-f73b8b79e41e', 'volume_name': 'volume-92af02b5-f635-42ea-ab66-f73b8b79e41e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc0239-d1b4-466f-a03a-e8a184c19ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc0239-d1b4-466f-a03a-e8a184c19ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ac4d4e-161f-48b4-87dd-7f9691eac31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume 92af02b5-f635-42ea-ab66-f73b8b79e41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92af02b5-f635-42ea-ab66-f73b8b79e41e', 'volume_size': 1} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-192135464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92af02b5-f635-42ea-ab66-f73b8b79e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3c55ce7ae4cb292df0906248a5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:41Z,use_quota=True,user_id='6611ee0f506a48d1bcef594fa3e482f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Creating volume 92af02b5-f635-42ea-ab66-f73b8b79e41e {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:41 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e 1073741824 Feb 27 02:06:41 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ce4987e2-d913-43d1-8a80-000caa4a868a" returned: 0 in 0.643s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-ce4987e2-d913-43d1-8a80-000caa4a868a" released by "delete_volume" :: held 1.497s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:41 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9928d326-f277-4c69-86b5-59b91ca03d86" returned: 0 in 0.874s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "cinder-quobyte-9928d326-f277-4c69-86b5-59b91ca03d86" released by "delete_volume" :: held 1.706s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Created reservations ['c59802a1-b2b4-44e1-a08d-cd0d76f97dac', '66252ee7-f370-411a-ae0b-2b7041059e52', '50eaf979-d35e-4709-be86-af7bc0a2295d', '7284f170-43e1-4b03-bdde-b3d0a5ce125d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Created reservations ['6ba291e8-4f77-4728-8fd7-62a955f8755b', 'e33a3142-7467-43fe-a0ce-9feb9fba3e99', '2b084259-886e-41e5-9d1c-2dda0556e856', '7620a14a-f3dc-44c8-9dfc-7c02dfda28ab'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:41 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:41 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Created reservations ['82aa0514-6fa5-4b74-9b01-9d6128c5f63a'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:41 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e 1073741824" returned: 0 in 0.691s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:41 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e Feb 27 02:06:41 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.649s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Deleted volume successfully. Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898f6a83-d236-495c-aed5-91dd738a481d tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-ce4987e2-d913-43d1-8a80-000caa4a868a-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:42 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.698s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Deleted volume successfully. Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-44280bac-eae5-45db-abb6-413e32f031d3-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-44280bac-eae5-45db-abb6-413e32f031d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0e95398a-131e-45e4-896a-13e0949db9c7 tempest-VolumesListAdminTestJSON-366626650 None] Lock "cinder-9928d326-f277-4c69-86b5-59b91ca03d86-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-quobyte-44280bac-eae5-45db-abb6-413e32f031d3" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-44280bac-eae5-45db-abb6-413e32f031d3" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c2fab-bdd2-425f-92d5-dc8df7c17e12]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.589s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-554dcfa7-f201-438b-a074-1d0075317948 tempest-GroupsV320Test-1826843317 None] Delete group completed successfully. Feb 27 02:06:42 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 Feb 27 02:06:42 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e" returned: 0 in 0.665s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ac4d4e-161f-48b4-87dd-7f9691eac31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92af02b5-f635-42ea-ab66-f73b8b79e41e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc9fc6f-c2f4-41ae-b2a1-10b3aa05bfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:42 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume volume-92af02b5-f635-42ea-ab66-f73b8b79e41e (92af02b5-f635-42ea-ab66-f73b8b79e41e): created successfully Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc9fc6f-c2f4-41ae-b2a1-10b3aa05bfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Flow 'volume_create_manager' (cffa0a6c-fe78-4260-89f3-e9dfc02720bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9009b53e-6809-4da5-922f-a841e7e3cfdd tempest-VolumeQuotasAdminTestJSON-148121222 None] Created volume successfully. Feb 27 02:06:43 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3 Feb 27 02:06:43 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "cinder-92af02b5-f635-42ea-ab66-f73b8b79e41e-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "cinder-92af02b5-f635-42ea-ab66-f73b8b79e41e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "cinder-quobyte-92af02b5-f635-42ea-ab66-f73b8b79e41e" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "cinder-quobyte-92af02b5-f635-42ea-ab66-f73b8b79e41e" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[595716da-06bf-4774-a706-66ccdb5975fd]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e Feb 27 02:06:43 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-44280bac-eae5-45db-abb6-413e32f031d3" returned: 0 in 0.614s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-44280bac-eae5-45db-abb6-413e32f031d3" released by "delete_volume" :: held 1.230s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Created reservations ['d3d3c655-87f6-4a7f-85b0-a08e851178e5', '7fd12dce-5c7f-4759-9743-ed4595f46e50', 'cd1d64c3-d9da-4411-8619-a79472f6c021', '9012e501-41de-4fb9-b60f-e4c156214dca'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-29c1025c-0d85-4e62-b22c-e080115b2396 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Terminate volume connection completed successfully. Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-29c1025c-0d85-4e62-b22c-e080115b2396 tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Deleting attachment 2b15e96d-cf15-4892-be92-3aa44210cf16. {{(pid=83211) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:43 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e" returned: 0 in 0.607s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e Feb 27 02:06:43 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.528s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:44 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Deleted volume successfully. Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d3e53da-ff9e-4778-949c-af2646b56324 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-44280bac-eae5-45db-abb6-413e32f031d3-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "cinder-95d9f2e6-0e97-4c76-aa34-b6fe47a25890-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-95d9f2e6-0e97-4c76-aa34-b6fe47a25890-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "cinder-quobyte-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-quobyte-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" acquired by "delete_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[761bb945-b751-48ad-b92f-a2378f7afc87]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-92af02b5-f635-42ea-ab66-f73b8b79e41e" returned: 0 in 0.635s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "cinder-quobyte-92af02b5-f635-42ea-ab66-f73b8b79e41e" released by "delete_volume" :: held 1.283s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Created reservations ['6aa1ca6d-adc1-41f6-81a0-510a9fd01eb8', 'be8b02ae-f91d-41a9-a1c1-a4aa5a5fec3d', '8e0b5d3a-5d45-4be2-9b35-6c6670ec8d95', '79b6237c-6746-4a5a-a19e-7f050da7a79d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:44 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 Feb 27 02:06:44 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-161d10eb-ed99-4e27-aeef-24a1d3395056-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-161d10eb-ed99-4e27-aeef-24a1d3395056-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:44 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "cinder-quobyte-161d10eb-ed99-4e27-aeef-24a1d3395056" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-161d10eb-ed99-4e27-aeef-24a1d3395056" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[29752f9a-3019-40fd-aaee-b8828796c019]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 Feb 27 02:06:44 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" returned: 0 in 0.669s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890 Feb 27 02:06:45 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.604s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:45 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Deleted volume successfully. Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-652bf8c0-cb90-447f-9355-9e9a8d8a400d tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "cinder-92af02b5-f635-42ea-ab66-f73b8b79e41e-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:45 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056" returned: 0 in 0.797s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056 Feb 27 02:06:45 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" returned: 0 in 0.625s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-quobyte-95d9f2e6-0e97-4c76-aa34-b6fe47a25890" released by "delete_volume" :: held 1.326s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.quota [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Created reservations ['4e3f0335-0bac-48ec-aedf-4e693516f490', 'ee7e86eb-9494-47ec-a0c8-1dc445e77644', 'cbc8e5dd-4b13-484c-9588-3abfca704d97', '18b7ae42-b8fb-4581-8af7-8a330d3ffe49'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Flow 'volume_create_manager' (56e8ac2b-1de3-4368-8230-b83cf7e99495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d578840-7026-4aea-8273-bf736a812ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d578840-7026-4aea-8273-bf736a812ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-964022911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1000c977-d14e-44d8-88b5-3b2ad8f1285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3c55ce7ae4cb292df0906248a5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:46Z,use_quota=True,user_id='6611ee0f506a48d1bcef594fa3e482f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c28b02-106b-4da9-b992-e418b1e4b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c28b02-106b-4da9-b992-e418b1e4b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723ed3f3-a104-40ae-919a-91103c24c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723ed3f3-a104-40ae-919a-91103c24c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1000c977-d14e-44d8-88b5-3b2ad8f1285f', 'volume_name': 'volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4689f1-abda-4800-a7fd-cd586084c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4689f1-abda-4800-a7fd-cd586084c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff617852-cca4-480c-8992-4dfa2436420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume 1000c977-d14e-44d8-88b5-3b2ad8f1285f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f', 'volume_size': 1} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-964022911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1000c977-d14e-44d8-88b5-3b2ad8f1285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed3c55ce7ae4cb292df0906248a5e2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:46Z,use_quota=True,user_id='6611ee0f506a48d1bcef594fa3e482f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Creating volume 1000c977-d14e-44d8-88b5-3b2ad8f1285f {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:45 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f 1073741824 Feb 27 02:06:46 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:46 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-161d10eb-ed99-4e27-aeef-24a1d3395056" returned: 0 in 0.619s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-quobyte-161d10eb-ed99-4e27-aeef-24a1d3395056" released by "delete_volume" :: held 1.441s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Created reservations ['d9c48104-9a0f-4a78-b6e2-03fc16e8e5c9', '57bce8c0-a202-4bc4-a671-f4c18c05deeb', 'dc49577e-9136-457c-bfe9-791429e6b5a7', '7b7994e2-51a2-4f02-b329-51fa3148b0f4'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:46 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.524s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.manager [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Deleted volume successfully. Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-b4d1e837-a9b5-4e4a-969e-8d760782f229 req-372d2e45-e738-45df-aa0c-27053ed5a3cb tempest-ServerBootFromVolumeStableRescueTest-1534522184 None] Lock "cinder-95d9f2e6-0e97-4c76-aa34-b6fe47a25890-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:46 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f 1073741824" returned: 0 in 0.787s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f Feb 27 02:06:46 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.561s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Deleted volume successfully. Feb 27 02:06:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d44f8173-faac-4fbc-bb72-014647618444 tempest-VolumesListAdminTestJSON-9043886 None] Lock "cinder-161d10eb-ed99-4e27-aeef-24a1d3395056-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:47 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f" returned: 0 in 0.609s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff617852-cca4-480c-8992-4dfa2436420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8a4341-6d37-4d78-b94a-1828fff8ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Volume volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f (1000c977-d14e-44d8-88b5-3b2ad8f1285f): created successfully Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8a4341-6d37-4d78-b94a-1828fff8ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Flow 'volume_create_manager' (56e8ac2b-1de3-4368-8230-b83cf7e99495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fe095712-39ea-4e58-aea7-cffd1d8a27e3 tempest-VolumeQuotasAdminTestJSON-148121222 None] Created volume successfully. Feb 27 02:06:48 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-17144dbf-ff8c-48af-b4c7-237cf890ee32 tempest-VolumeQuotasAdminTestJSON-888867936 None] Transfer volume completed successfully. Feb 27 02:06:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Acquiring lock "cinder-1000c977-d14e-44d8-88b5-3b2ad8f1285f-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "cinder-1000c977-d14e-44d8-88b5-3b2ad8f1285f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Acquiring lock "cinder-quobyte-1000c977-d14e-44d8-88b5-3b2ad8f1285f" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "cinder-quobyte-1000c977-d14e-44d8-88b5-3b2ad8f1285f" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4355be3-ef1e-48db-b22f-3c2b4a4eb132]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f Feb 27 02:06:50 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f" returned: 0 in 1.057s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f Feb 27 02:06:51 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1000c977-d14e-44d8-88b5-3b2ad8f1285f" returned: 0 in 0.692s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "cinder-quobyte-1000c977-d14e-44d8-88b5-3b2ad8f1285f" released by "delete_volume" :: held 1.804s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Created reservations ['1e07d866-f9fa-4d7d-a563-4cb443ae1341', '0a08d8fb-d811-4cd4-8914-90a68cfe37b0', '5936ca5e-0da7-4c84-8102-666b6a9ba4d1', '9f11bad5-46cc-4fb3-a520-f50e8f1e7eff'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:06:51 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.555s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Deleted volume successfully. Feb 27 02:06:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c85b1a1d-2817-4029-84cd-ee76f585c664 tempest-VolumeQuotasAdminTestJSON-120542455 None] Lock "cinder-1000c977-d14e-44d8-88b5-3b2ad8f1285f-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=191,cinder:UPDATE=213,cinder:INSERT=37,cinder:DELETE=9 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=213,cinder:DELETE=13,cinder:SELECT=181,cinder:INSERT=59 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Flow 'volume_create_manager' (7d84b8f5-6e57-418a-ba91-d3306e9dc8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067bf65-9b4c-4a51-bc6b-5613b17be89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067bf65-9b4c-4a51-bc6b-5613b17be89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1912518972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ebb033-dd9b-43c9-baa9-c8a1b0248a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e787e220d4c04b36876e1187184bef0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='90ae9826f2ef4845a21ab48f1bed401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42445dc-efc7-4027-b439-1efd2b18132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42445dc-efc7-4027-b439-1efd2b18132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06eac65f-3c28-4d24-9af8-dd0373c735e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06eac65f-3c28-4d24-9af8-dd0373c735e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ebb033-dd9b-43c9-baa9-c8a1b0248a9d', 'volume_name': 'volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deae5efa-9f6c-488a-8e20-88a12b548c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deae5efa-9f6c-488a-8e20-88a12b548c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2905389c-3030-4f7a-8c7a-808a384666a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:54 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d', 'volume_size': 1} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1912518972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ebb033-dd9b-43c9-baa9-c8a1b0248a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e787e220d4c04b36876e1187184bef0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='90ae9826f2ef4845a21ab48f1bed401a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Creating volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:54 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:06:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d 1073741824 Feb 27 02:06:54 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d 1073741824" returned: 0 in 0.722s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d Feb 27 02:06:55 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" returned: 0 in 0.567s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2905389c-3030-4f7a-8c7a-808a384666a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbd0f9a-9480-499e-9ff0-e0c959158265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Volume volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d (82ebb033-dd9b-43c9-baa9-c8a1b0248a9d): created successfully Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbd0f9a-9480-499e-9ff0-e0c959158265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Flow 'volume_create_manager' (7d84b8f5-6e57-418a-ba91-d3306e9dc8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-03e006dc-3bdc-4108-afe1-904c2015162e tempest-SnapshotsActionsTest-1422186922 None] Created volume successfully. Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Creating offline snapshot 086267d4-9395-4c9c-944c-c4bc3403d864 of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f793300-1cf5-42d3-b312-c7bdd76ecfb1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d Feb 27 02:06:57 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Flow 'volume_create_manager' (41f2fafe-3fac-4c32-95c4-67ec0418b694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea32c3-2c75-4007-8546-7363825ffb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea32c3-2c75-4007-8546-7363825ffb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1463152143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d5d4dc-1647-4920-81b8-2298d6826778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945dd7bf1724408988e549e38ab44507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:58Z,use_quota=True,user_id='9b2c4789d2b346ce8e9fee7c15e1abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd710698-8e61-47f1-9b19-57c3602dbee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd710698-8e61-47f1-9b19-57c3602dbee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d963c62-4112-4164-816e-a1825a5fa057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d963c62-4112-4164-816e-a1825a5fa057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d5d4dc-1647-4920-81b8-2298d6826778', 'volume_name': 'volume-a6d5d4dc-1647-4920-81b8-2298d6826778', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e3b662-4bc7-43ed-a9f7-99f9a1f2d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e3b662-4bc7-43ed-a9f7-99f9a1f2d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd49d46-f9ae-459a-b995-e33f0547e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Volume a6d5d4dc-1647-4920-81b8-2298d6826778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d5d4dc-1647-4920-81b8-2298d6826778', 'volume_size': 1} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" returned: 0 in 0.722s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 1G Feb 27 02:06:57 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 1G" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:06:58 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 is being set with open permissions: ugo+rw Feb 27 02:06:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:06:59 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Flow 'volume_create_manager' (4786b898-a743-4d11-8b4a-99d7a7d2f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e8b65-05ef-4058-8367-deb2ee60f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e8b65-05ef-4058-8367-deb2ee60f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1763797932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2215c9f-fe23-430d-af23-a7f258210c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802d59fa9e6d406fb859f45feb4f3588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:59Z,use_quota=True,user_id='8bab8e47e7644f27af7aa86872856321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eebaa64-9755-4ff5-a215-56e50d5e08df),volume_type_id=2eebaa64-9755-4ff5-a215-56e50d5e08df)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94764961-2e3e-498d-926e-453c1db617f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94764961-2e3e-498d-926e-453c1db617f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629ec8f-1653-406b-9edd-f424fb8b1e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629ec8f-1653-406b-9edd-f424fb8b1e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2215c9f-fe23-430d-af23-a7f258210c3a', 'volume_name': 'volume-f2215c9f-fe23-430d-af23-a7f258210c3a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec648645-5c79-48c9-8504-2228f92ece68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec648645-5c79-48c9-8504-2228f92ece68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c07964-a90b-4120-81de-543eefe136e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Volume f2215c9f-fe23-430d-af23-a7f258210c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2215c9f-fe23-430d-af23-a7f258210c3a', 'volume_size': 1} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:59 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info Feb 27 02:06:59 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info" returned: 0 in 0.501s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info is being set with open permissions: ugo+rw Feb 27 02:06:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info Feb 27 02:06:59 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.info" returned: 0 in 0.582s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1463152143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d5d4dc-1647-4920-81b8-2298d6826778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945dd7bf1724408988e549e38ab44507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:58Z,use_quota=True,user_id='9b2c4789d2b346ce8e9fee7c15e1abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Creating volume a6d5d4dc-1647-4920-81b8-2298d6826778 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:00 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 1073741824 Feb 27 02:07:00 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b423ba9a-c79c-4a99-a212-134bbac3699e tempest-SnapshotsActionsTest-1422186922 None] Create snapshot completed successfully Feb 27 02:07:01 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 1073741824" returned: 0 in 0.615s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:01 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 Feb 27 02:07:01 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:01 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778" returned: 0 in 0.502s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1763797932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2215c9f-fe23-430d-af23-a7f258210c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802d59fa9e6d406fb859f45feb4f3588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:59Z,use_quota=True,user_id='8bab8e47e7644f27af7aa86872856321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eebaa64-9755-4ff5-a215-56e50d5e08df),volume_type_id=2eebaa64-9755-4ff5-a215-56e50d5e08df)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Creating volume f2215c9f-fe23-430d-af23-a7f258210c3a {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:01 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:01 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a 1073741824 Feb 27 02:07:01 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd49d46-f9ae-459a-b995-e33f0547e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d5d4dc-1647-4920-81b8-2298d6826778', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4127a5-c2fd-4f3e-ad84-240336125244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:01 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Volume volume-a6d5d4dc-1647-4920-81b8-2298d6826778 (a6d5d4dc-1647-4920-81b8-2298d6826778): created successfully Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4127a5-c2fd-4f3e-ad84-240336125244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:01 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Flow 'volume_create_manager' (41f2fafe-3fac-4c32-95c4-67ec0418b694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:01 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0aa72d63-57b1-4b6a-b632-d5125492bab3 tempest-VolumesTransfersV357Test-524788352 None] Created volume successfully. Feb 27 02:07:02 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a 1073741824" returned: 0 in 0.655s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a Feb 27 02:07:02 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-534e7388-b120-4796-8f25-1a906f2e3eff tempest-VolumesTransfersV357Test-1121647964 None] Transfer volume completed successfully. Feb 27 02:07:02 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.132s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c07964-a90b-4120-81de-543eefe136e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2215c9f-fe23-430d-af23-a7f258210c3a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2340aeba-7e3d-498c-aaf9-ec7b6eb42d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Creating offline snapshot 0fac4a0e-28c2-4b2f-a370-20cae5c433aa of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Volume volume-f2215c9f-fe23-430d-af23-a7f258210c3a (f2215c9f-fe23-430d-af23-a7f258210c3a): created successfully Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2340aeba-7e3d-498c-aaf9-ec7b6eb42d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Flow 'volume_create_manager' (4786b898-a743-4d11-8b4a-99d7a7d2f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b16a6d-5087-44d4-8da6-4599c2c75723]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1250921d-ec56-4a0c-930d-139e119376db tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Created volume successfully. Feb 27 02:07:03 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:03 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "cinder-a6d5d4dc-1647-4920-81b8-2298d6826778-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-a6d5d4dc-1647-4920-81b8-2298d6826778-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "cinder-quobyte-a6d5d4dc-1647-4920-81b8-2298d6826778" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-quobyte-a6d5d4dc-1647-4920-81b8-2298d6826778" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef0113-9f31-4dba-b372-a93dff960fe4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 Feb 27 02:07:03 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:03 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.766s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa 1G Feb 27 02:07:03 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778" returned: 0 in 0.584s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778 Feb 27 02:07:04 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.549s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6da1eeb3-7255-4f58-b84f-4c6b129687fa tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Retype volume completed successfully. Feb 27 02:07:04 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa 1G" returned: 0 in 0.607s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa Feb 27 02:07:04 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6d5d4dc-1647-4920-81b8-2298d6826778" returned: 0 in 0.479s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-quobyte-a6d5d4dc-1647-4920-81b8-2298d6826778" released by "delete_volume" :: held 1.111s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Created reservations ['aacd4b04-7386-40c7-8c75-c3c2ba2efb24', 'a3e31e54-620a-4b0a-a1fb-61b9c7db3a9e', '836ae0a0-e292-4506-b0e1-a876500c5c78', 'bb043463-93a2-4e79-bb37-c3a73bdea6af'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:04 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "cinder-f2215c9f-fe23-430d-af23-a7f258210c3a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "cinder-f2215c9f-fe23-430d-af23-a7f258210c3a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "cinder-quobyte-f2215c9f-fe23-430d-af23-a7f258210c3a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "cinder-quobyte-f2215c9f-fe23-430d-af23-a7f258210c3a" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfbc100-5dcd-4083-9414-97a6d688fc04]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa is being set with open permissions: ugo+rw Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa Feb 27 02:07:05 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a Feb 27 02:07:05 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.726s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Deleted volume successfully. Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-28fc94f0-bf5a-4a3c-bac0-950c81fd0fd6 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-a6d5d4dc-1647-4920-81b8-2298d6826778-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:05 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa" returned: 0 in 0.549s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-facc9b65-2341-4cdc-81d4-62011dc1afb9 tempest-SnapshotsActionsTest-1422186922 None] Create snapshot completed successfully Feb 27 02:07:05 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a Feb 27 02:07:05 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-0fac4a0e-28c2-4b2f-a370-20cae5c433aa-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Flow 'volume_create_manager' (17f33e03-fd81-4d6e-bb58-9ae8c2f7a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdbc3cf-d652-4e82-9a76-b6d44e42d3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-0fac4a0e-28c2-4b2f-a370-20cae5c433aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdbc3cf-d652-4e82-9a76-b6d44e42d3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1129472810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945dd7bf1724408988e549e38ab44507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:06Z,use_quota=True,user_id='9b2c4789d2b346ce8e9fee7c15e1abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677dda09-10f8-484c-ab4c-0e2fa2493142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677dda09-10f8-484c-ab4c-0e2fa2493142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa795be4-fef4-490f-a281-00d28ab3f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa795be4-fef4-490f-a281-00d28ab3f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92', 'volume_name': 'volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbbc243-d3ff-4f86-8bb1-96e96bf736f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbbc243-d3ff-4f86-8bb1-96e96bf736f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c403ac-c64c-48a5-9b28-f6d15c64045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Volume 1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92', 'volume_size': 1} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1129472810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945dd7bf1724408988e549e38ab44507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:06Z,use_quota=True,user_id='9b2c4789d2b346ce8e9fee7c15e1abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Creating volume 1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:06 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:06 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_snapshot" :: waited 0.087s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-0fac4a0e-28c2-4b2f-a370-20cae5c433aa" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2215c9f-fe23-430d-af23-a7f258210c3a" returned: 0 in 0.705s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 1073741824 Feb 27 02:07:06 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "cinder-quobyte-f2215c9f-fe23-430d-af23-a7f258210c3a" released by "delete_volume" :: held 1.392s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-0fac4a0e-28c2-4b2f-a370-20cae5c433aa" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Deleting offline snapshot 0fac4a0e-28c2-4b2f-a370-20cae5c433aa of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] snapshot_file for this snap is: volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d1d71-456e-4060-8c15-797a6c7feb7c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack cinder-volume[83211]: WARNING cinder.quota [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:06 devstack cinder-volume[83211]: WARNING cinder.quota [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Created reservations ['1064c7bd-c128-4bc6-8bda-d0551535bd4f', '8fd879be-2288-452a-a806-5dccac6e90e4', 'be79cbca-aeec-4c8a-a0a8-6589025bfee3', '19343ba4-8ddc-478e-bc19-cd8e12e8e0d3'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa Feb 27 02:07:06 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:06 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 1073741824" returned: 0 in 0.776s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 Feb 27 02:07:07 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.781s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Deleted volume successfully. Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc596565-5fb3-40c7-94d5-75c11657536b tempest-VolumeRetypeWithoutMigrationTest-1517064418 None] Lock "cinder-f2215c9f-fe23-430d-af23-a7f258210c3a-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:07 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa" returned: 0 in 1.064s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4408c6b2-cb02-4c6a-abcc-b918b9bffb51]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:07 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" returned: 0 in 0.730s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c403ac-c64c-48a5-9b28-f6d15c64045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cc284b-7f18-444b-b581-6d822afb68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Volume volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 (1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92): created successfully Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cc284b-7f18-444b-b581-6d822afb68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Flow 'volume_create_manager' (17f33e03-fd81-4d6e-bb58-9ae8c2f7a07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d50f389b-ff27-442d-aee0-1a5a5f31fd5c tempest-VolumesTransfersV357Test-524788352 None] Created volume successfully. Feb 27 02:07:08 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.737s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa Feb 27 02:07:08 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "cinder-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "cinder-quobyte-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-quobyte-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2764f-847e-46b7-a4cc-2b5a41ac7698]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 Feb 27 02:07:08 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa" returned: 0 in 0.775s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa Feb 27 02:07:09 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" returned: 0 in 0.684s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92 Feb 27 02:07:09 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.0fac4a0e-28c2-4b2f-a370-20cae5c433aa" returned: 0 in 0.620s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-0fac4a0e-28c2-4b2f-a370-20cae5c433aa" released by "_delete_snapshot" :: held 3.278s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_snapshot" :: held 3.312s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:09 devstack cinder-volume[83211]: WARNING cinder.quota [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Created reservations ['6ff5a5d8-8be8-472c-9cdc-84dd2235e7d0', 'e33fd595-65be-4b93-864b-9b7397495c00', '47c15997-ce32-4732-a4f2-04fba3b22b9a', '842072a9-bfd4-436d-8997-6b1d76921281'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:09 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Delete snapshot completed successfully. Feb 27 02:07:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ac327278-9a60-40fb-81fc-f5d74002abd0 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-0fac4a0e-28c2-4b2f-a370-20cae5c433aa-delete_snapshot" released by "delete_snapshot" :: held 3.568s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:10 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" returned: 0 in 0.701s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-quobyte-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92" released by "delete_volume" :: held 1.445s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Created reservations ['d1151832-725f-4cc8-a04c-de40d8c69f41', '0d11ed68-f38b-4b73-91eb-629aaab7b3e5', '1af52502-d167-457e-9882-8fbf8b4a374c', 'f63d70b1-fd79-40d7-b46d-a00ddf9abcaf'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:10 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Creating offline snapshot 1e6e0252-66e9-4a21-80c1-94cadd98b74c of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa8037-5aaf-4e7a-ac52-d7c66a58b229]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:11 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.923s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Deleted volume successfully. Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9f4ecdb-d72f-41fd-9d82-6fbf314f66d4 tempest-VolumesTransfersV357Test-1115788826 None] Lock "cinder-1e3bb7fd-2b71-4a8d-adad-e1f1bab72c92-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:11 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.662s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c 1G Feb 27 02:07:11 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c 1G" returned: 0 in 0.786s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c Feb 27 02:07:12 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c" returned: 0 in 0.638s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c is being set with open permissions: ugo+rw Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c Feb 27 02:07:13 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:13 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c" returned: 0 in 0.669s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2964f200-1e66-4cb3-b4e4-eec9355e85e4 tempest-SnapshotsActionsTest-1422186922 None] Create snapshot completed successfully Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Flow 'volume_create_manager' (a849e6fd-3575-45a0-830a-6f9d0b4c79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e24e31b-53f0-4b91-943e-7fdbaf5dcda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e24e31b-53f0-4b91-943e-7fdbaf5dcda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-990317552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc6632c-e17a-4ce5-b18f-15aec57d926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f46d4f55f14eb3a77e26e1f6cdeaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:14Z,use_quota=True,user_id='8d1cea96a3e541f68565e8840a41bc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fdd246-5b28-4a22-aabc-3af9e6b9ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fdd246-5b28-4a22-aabc-3af9e6b9ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2ac061-e9a8-4a94-9d26-57e5a3c6fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2ac061-e9a8-4a94-9d26-57e5a3c6fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc6632c-e17a-4ce5-b18f-15aec57d926c', 'volume_name': 'volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963dbcac-9b20-4d80-b7cd-c5d876635c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963dbcac-9b20-4d80-b7cd-c5d876635c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fd679e-48e8-4cfe-8b81-099932dde73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Volume dbc6632c-e17a-4ce5-b18f-15aec57d926c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c', 'volume_size': 1} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-990317552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc6632c-e17a-4ce5-b18f-15aec57d926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f46d4f55f14eb3a77e26e1f6cdeaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:14Z,use_quota=True,user_id='8d1cea96a3e541f68565e8840a41bc76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Creating volume dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:14 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c 1073741824 Feb 27 02:07:14 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-1e6e0252-66e9-4a21-80c1-94cadd98b74c-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:14 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.747s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-1e6e0252-66e9-4a21-80c1-94cadd98b74c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-1e6e0252-66e9-4a21-80c1-94cadd98b74c" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-1e6e0252-66e9-4a21-80c1-94cadd98b74c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Deleting offline snapshot 1e6e0252-66e9-4a21-80c1-94cadd98b74c of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] snapshot_file for this snap is: volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fb2b54-76a1-4225-8589-b59478259d1e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c Feb 27 02:07:14 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c 1073741824" returned: 0 in 0.791s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c Feb 27 02:07:14 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c" returned: 0 in 0.785s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78abc32-2faf-4d2a-b5d4-fd74f37eae11]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:15 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fd679e-48e8-4cfe-8b81-099932dde73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a90d85-b182-49cf-9728-c3a2afa4725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:15 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Volume volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c (dbc6632c-e17a-4ce5-b18f-15aec57d926c): created successfully Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a90d85-b182-49cf-9728-c3a2afa4725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Flow 'volume_create_manager' (a849e6fd-3575-45a0-830a-6f9d0b4c79cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-86537205-e922-438a-b6e8-d74604a587cb tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Created volume successfully. Feb 27 02:07:15 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.663s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c Feb 27 02:07:15 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Creating offline snapshot e2ac08cd-8b7c-402b-89e9-02d6356b8f7f of volume dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a424ba-835a-4c79-aa3d-0f67d937301b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c Feb 27 02:07:16 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c" returned: 0 in 0.688s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c Feb 27 02:07:16 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (830b08a2-b93d-405f-a380-cbbaab2918e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8509ce87-3e33-4e5c-8351-78060b682673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8509ce87-3e33-4e5c-8351-78060b682673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185567344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:17Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4789a8c6-c9a8-40d3-a86b-c886fc2c080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4789a8c6-c9a8-40d3-a86b-c886fc2c080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5079df-b850-4c3f-94e9-d9c3e5330b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5079df-b850-4c3f-94e9-d9c3e5330b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe', 'volume_name': 'volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18be9116-afcc-4887-9179-9e3458b1a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18be9116-afcc-4887-9179-9e3458b1a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed83adae-d5cb-44ae-8b52-654ee1fe2f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Volume 6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe', 'volume_size': 1} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:16 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c" returned: 0 in 0.654s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f 1G Feb 27 02:07:17 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.1e6e0252-66e9-4a21-80c1-94cadd98b74c" returned: 0 in 0.609s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-1e6e0252-66e9-4a21-80c1-94cadd98b74c" released by "_delete_snapshot" :: held 2.817s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_snapshot" :: held 2.833s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Created reservations ['f9c41394-14a7-4c30-b82a-a40387cd8f44', '9edac7cf-044b-4727-b9e3-140cefedb4c1', '8eae72a9-8df3-481b-9790-58892b7c8299', 'c7ef7d3d-1071-4e00-937b-cb1231a0050c'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Delete snapshot completed successfully. Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a96b1522-2b59-4604-b83c-9a4f485359ac tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-1e6e0252-66e9-4a21-80c1-94cadd98b74c-delete_snapshot" released by "delete_snapshot" :: held 2.961s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:17 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f 1G" returned: 0 in 0.753s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f Feb 27 02:07:17 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" returned: 0 in 0.530s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f is being set with open permissions: ugo+rw Feb 27 02:07:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f Feb 27 02:07:18 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info Feb 27 02:07:18 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info" returned: 0 in 0.462s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info is being set with open permissions: ugo+rw Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info Feb 27 02:07:19 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.info" returned: 0 in 0.569s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.538s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.158s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-185567344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:17Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Creating volume 6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:19 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe 1073741824 Feb 27 02:07:19 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1f3cd848-3676-46b4-a2f0-4cd3e3fdce1f tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Create snapshot completed successfully Feb 27 02:07:20 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe 1073741824" returned: 0 in 0.804s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe Feb 27 02:07:20 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "cinder-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "cinder-quobyte-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Deleting offline snapshot e2ac08cd-8b7c-402b-89e9-02d6356b8f7f of volume dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] snapshot_file for this snap is: volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e66d1ec-0cfb-4357-a2bf-f874af5ca249]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f Feb 27 02:07:21 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" returned: 0 in 0.602s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.583s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed83adae-d5cb-44ae-8b52-654ee1fe2f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0971f3-5d52-460b-84c3-efd6d84c9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Creating offline snapshot 7cbba753-8907-468c-8756-d12cfcbfa43b of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:21 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Volume volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe (6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe): created successfully Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0971f3-5d52-460b-84c3-efd6d84c9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (830b08a2-b93d-405f-a380-cbbaab2918e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd61c66-da6b-4595-a46e-6af0c711e4d3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-80d63d0b-fb5a-4c63-bd43-992ed7959002 tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:07:21 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:21 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" returned: 0 in 0.626s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[72043745-d66c-4b1a-a6a6-649def1e3652]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c Feb 27 02:07:21 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b 1G Feb 27 02:07:22 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c" returned: 0 in 0.667s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f Feb 27 02:07:22 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (622bbb9f-47d4-4439-aee9-3351a31cfb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a45d07c-4641-4a33-a36d-fe4c5b72842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a45d07c-4641-4a33-a36d-fe4c5b72842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-23518921',display_name='tempest-VolumesGetTest-Volume-1619990401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7c3aee-7947-482b-9aba-a7751669df31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7c3aee-7947-482b-9aba-a7751669df31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6321fe64-d4f1-4c28-bb1c-383b11251640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6321fe64-d4f1-4c28-bb1c-383b11251640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b', 'volume_name': 'volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c086f-69a9-40c0-acd1-c57addf4c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c086f-69a9-40c0-acd1-c57addf4c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ac4b5f-350b-4f94-97d2-f542894c4920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Volume f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b', 'volume_size': 1} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:22 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b 1G" returned: 0 in 0.751s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b Feb 27 02:07:22 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" returned: 0 in 0.752s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f Feb 27 02:07:23 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b" returned: 0 in 0.710s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b is being set with open permissions: ugo+rw Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b Feb 27 02:07:23 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c.e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" returned: 0 in 0.617s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f" released by "_delete_snapshot" :: held 2.732s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" released by "delete_snapshot" :: held 2.757s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Created reservations ['8f8a20ea-a599-4bfa-80e0-44bb8e1d5a7a', '491b5c5b-1c75-4ae4-b48f-64ee390307b6', '9fdbdfed-6251-4d2e-bf54-b1dc17e87918', '606b0b45-a973-4377-837c-678058e30f31'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:23 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Delete snapshot completed successfully. Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ee6bf469-c25d-4a58-9b75-536e16294a48 tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-e2ac08cd-8b7c-402b-89e9-02d6356b8f7f-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:23 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b" returned: 0 in 0.508s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-23518921',display_name='tempest-VolumesGetTest-Volume-1619990401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Creating volume f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:23 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b 1073741824 Feb 27 02:07:24 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c4ff7b47-c3f1-481b-9b0f-aaa8f99320b0 tempest-SnapshotsActionsTest-1422186922 None] Create snapshot completed successfully Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "cinder-dbc6632c-e17a-4ce5-b18f-15aec57d926c-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-dbc6632c-e17a-4ce5-b18f-15aec57d926c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[08691fc8-8496-4bcf-9dcc-8544b5c1579d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c Feb 27 02:07:24 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b 1073741824" returned: 0 in 0.649s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b Feb 27 02:07:24 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c Feb 27 02:07:25 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-7cbba753-8907-468c-8756-d12cfcbfa43b-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-7cbba753-8907-468c-8756-d12cfcbfa43b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-7cbba753-8907-468c-8756-d12cfcbfa43b" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-7cbba753-8907-468c-8756-d12cfcbfa43b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Deleting offline snapshot 7cbba753-8907-468c-8756-d12cfcbfa43b of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] snapshot_file for this snap is: volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ad101-9ace-4288-9b51-c645a641e0ba]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" returned: 0 in 0.539s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ac4b5f-350b-4f94-97d2-f542894c4920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d7c396-a6c6-4851-9b0b-d78cb91978a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Volume volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b (f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b): created successfully Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d7c396-a6c6-4851-9b0b-d78cb91978a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (622bbb9f-47d4-4439-aee9-3351a31cfb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-428ea4bc-85c3-4890-8c08-97301b2a4d3e tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:07:25 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b Feb 27 02:07:25 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-dbc6632c-e17a-4ce5-b18f-15aec57d926c" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-quobyte-dbc6632c-e17a-4ce5-b18f-15aec57d926c" released by "delete_volume" :: held 1.147s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Created reservations ['af6c2ace-b958-43cc-8583-4db5b71bbec8', 'a1e43351-e2bb-40f4-b048-d085b2a228e5', '5050f011-7e5f-4414-ae3b-014edc1edd0e', '804c730a-5584-442c-b78a-2fc8d26bbb6d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:25 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b" returned: 0 in 0.669s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e721db-e76b-4a06-ab8c-bc8683825dec]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "cinder-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:25 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[525ddab7-8285-4cae-a25c-c5003021c6c2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:26 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Deleted volume successfully. Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-80052c52-6fbd-4d88-9526-f321d64effff tempest-VolumeSnapshotQuotasNegativeTestJSON-148708365 None] Lock "cinder-dbc6632c-e17a-4ce5-b18f-15aec57d926c-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:26 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:26 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b Feb 27 02:07:26 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" returned: 0 in 0.688s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.842s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:26 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b Feb 27 02:07:26 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b Feb 27 02:07:26 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" returned: 0 in 0.582s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b" released by "delete_volume" :: held 1.306s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Created reservations ['dd349921-49fa-4193-979a-8ea1d3cf3c33', 'eeffd8b8-b3fe-4510-ae33-9814ef1fd329', '68b0cbf3-a02b-4ddf-ab1c-cab55b064474', '88540320-caba-4b8c-b016-05438ce32516'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:27 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b" returned: 0 in 0.783s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b Feb 27 02:07:27 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.631s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:07:28 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.7cbba753-8907-468c-8756-d12cfcbfa43b" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47d6ca81-1b1a-490f-b049-9e7eaa2eb18d tempest-VolumesGetTest-642185965 None] Lock "cinder-f254a45d-6ff8-4797-b8a1-2d9dc7c8ec3b-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-7cbba753-8907-468c-8756-d12cfcbfa43b" released by "_delete_snapshot" :: held 2.957s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_snapshot" :: held 2.976s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Created reservations ['a3712c2c-01d6-4239-b065-1e7b724dd630', 'd5eaac17-7414-4d63-9750-403910bf555a', '6768df7a-98c2-476f-b121-b560a940cedb', '84c204a6-9975-4585-93e1-cba3170b6683'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Delete snapshot completed successfully. Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f0c03602-ba98-4a66-a8b9-35a6bf8f14f7 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-7cbba753-8907-468c-8756-d12cfcbfa43b-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "cinder-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" acquired by "delete_volume" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeed984-66c4-4fe2-ae78-c0d38cd880e2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe Feb 27 02:07:28 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Creating offline snapshot 44d7dc1d-4bd9-4380-90dc-2447745b3b40 of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f08e3-b09c-4ea4-9fbb-ec349d535390]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:28 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" returned: 0 in 0.735s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe Feb 27 02:07:29 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.737s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 1G Feb 27 02:07:29 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" returned: 0 in 0.598s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe" released by "delete_volume" :: held 1.366s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Created reservations ['1a3ec688-8ae2-4028-99db-09ffc6662655', '8cc73841-7fe7-4673-8f16-edccfe83b624', 'bc6c9ffa-0e3e-4b9a-978b-527d84590646', '03fa0c45-ced3-428a-8ad4-950d3c2550d3'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:29 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 1G" returned: 0 in 0.729s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 Feb 27 02:07:30 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:30 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Flow 'volume_create_manager' (0a0ba935-bb82-4da4-9b88-1069582caa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a32cad3-2717-4f9b-b4b7-34db21a5fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.645s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a32cad3-2717-4f9b-b4b7-34db21a5fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-749974823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7362991d-27b6-481b-a60b-31cfbdd66f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be86a7f2fb4e4b1ead3c7cd4f32341af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:30Z,use_quota=True,user_id='f433a3e942f8418ebd7eba58a8c69994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edc3605-8402-4eae-b9d0-e67076c1ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edc3605-8402-4eae-b9d0-e67076c1ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a3b4f0-cb10-4c4b-b3b0-c9ccde2e699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a3b4f0-cb10-4c4b-b3b0-c9ccde2e699b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7362991d-27b6-481b-a60b-31cfbdd66f99', 'volume_name': 'volume-7362991d-27b6-481b-a60b-31cfbdd66f99', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf578abf-80b1-4c31-9a5e-6357cb93de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf578abf-80b1-4c31-9a5e-6357cb93de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8c374b-e14b-4190-876f-33d880e9681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Volume 7362991d-27b6-481b-a60b-31cfbdd66f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7362991d-27b6-481b-a60b-31cfbdd66f99', 'volume_size': 1} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-88ad192a-1eef-4c93-95de-0e5af0f322a8 tempest-VolumesGetTest-642185965 None] Lock "cinder-6c0fe7aa-bb0f-496a-8b91-3c079c71c1fe-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:30 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40" returned: 0 in 0.635s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 is being set with open permissions: ugo+rw Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 Feb 27 02:07:30 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0fd82903-ac34-4c8c-8592-028b5f7355ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026624e3-84f2-4307-b3ae-473ce1001128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026624e3-84f2-4307-b3ae-473ce1001128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-817574323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec98454-7acb-4546-beec-40afb7176676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e5753-8fa1-42b2-af72-b738f86db049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6e5753-8fa1-42b2-af72-b738f86db049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19ba871-f141-4c11-94e1-f592dc6cbb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19ba871-f141-4c11-94e1-f592dc6cbb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec98454-7acb-4546-beec-40afb7176676', 'volume_name': 'volume-1ec98454-7acb-4546-beec-40afb7176676', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d236897f-aedb-4915-aad0-18d29ecb8b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d236897f-aedb-4915-aad0-18d29ecb8b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a90bc-627a-490f-bb43-3cc668ac0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Volume 1ec98454-7acb-4546-beec-40afb7176676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec98454-7acb-4546-beec-40afb7176676', 'volume_size': 1} Feb 27 02:07:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40" returned: 0 in 0.566s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-749974823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7362991d-27b6-481b-a60b-31cfbdd66f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be86a7f2fb4e4b1ead3c7cd4f32341af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:30Z,use_quota=True,user_id='f433a3e942f8418ebd7eba58a8c69994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Creating volume 7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:31 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8c15fc51-210f-416b-8330-9b40cc0479b4 tempest-SnapshotsActionsTest-1422186922 None] Create snapshot completed successfully Feb 27 02:07:31 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 1073741824 Feb 27 02:07:31 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-44d7dc1d-4bd9-4380-90dc-2447745b3b40-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-44d7dc1d-4bd9-4380-90dc-2447745b3b40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Acquiring lock "cinder-quobyte-44d7dc1d-4bd9-4380-90dc-2447745b3b40" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-44d7dc1d-4bd9-4380-90dc-2447745b3b40" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Deleting offline snapshot 44d7dc1d-4bd9-4380-90dc-2447745b3b40 of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] snapshot_file for this snap is: volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f4130-9994-4b90-8759-e5f73613e066]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 Feb 27 02:07:32 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 1073741824" returned: 0 in 0.795s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 Feb 27 02:07:32 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40" returned: 0 in 0.788s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbda5d5-67c1-41c3-b50d-259486d5e7be]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99" returned: 0 in 0.700s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-817574323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec98454-7acb-4546-beec-40afb7176676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Creating volume 1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:32 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:32 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8c374b-e14b-4190-876f-33d880e9681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7362991d-27b6-481b-a60b-31cfbdd66f99', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:32 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 1073741824 Feb 27 02:07:32 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74adf036-57e4-4fe1-9a03-ebfe3eda48f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Volume volume-7362991d-27b6-481b-a60b-31cfbdd66f99 (7362991d-27b6-481b-a60b-31cfbdd66f99): created successfully Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74adf036-57e4-4fe1-9a03-ebfe3eda48f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Flow 'volume_create_manager' (0a0ba935-bb82-4da4-9b88-1069582caa22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-02802976-0e31-4d98-8e55-b93c16a833cd tempest-SnapshotMetadataTestJSON-644215278 None] Created volume successfully. Feb 27 02:07:33 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.859s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 Feb 27 02:07:33 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 1073741824" returned: 0 in 0.865s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:33 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:07:33 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40" returned: 0 in 0.717s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40 Feb 27 02:07:34 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.580s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.545s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Creating offline snapshot ade103d6-e210-4d67-bbad-5a85e749168f of volume 7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a90bc-627a-490f-bb43-3cc668ac0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec98454-7acb-4546-beec-40afb7176676', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73896858-f7a5-4b8e-81da-13a6a4e5bc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd322b-007c-40ee-b34c-1d24926ad6e3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Volume volume-1ec98454-7acb-4546-beec-40afb7176676 (1ec98454-7acb-4546-beec-40afb7176676): created successfully Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73896858-f7a5-4b8e-81da-13a6a4e5bc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0fd82903-ac34-4c8c-8592-028b5f7355ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-136555b3-372d-4c87-a723-d76545c50f74 tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:07:34 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 Feb 27 02:07:34 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.44d7dc1d-4bd9-4380-90dc-2447745b3b40" returned: 0 in 0.500s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-44d7dc1d-4bd9-4380-90dc-2447745b3b40" released by "_delete_snapshot" :: held 2.935s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_snapshot" :: held 2.955s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Created reservations ['b6d24f97-4317-4785-9f8e-01e6491b5ef4', 'b17695b5-d52e-4131-b3a4-516769c25966', '148d85a4-8f4d-448d-8494-e0198936b317', '703aa807-dc97-40d8-82af-8fbeb8a13bf7'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Delete snapshot completed successfully. Feb 27 02:07:35 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3fb46ef3-f81b-4393-9bcb-55149ecbc5d9 tempest-SnapshotsActionsTest-253626112 None] Lock "cinder-44d7dc1d-4bd9-4380-90dc-2447745b3b40-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99" returned: 0 in 0.641s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f 1G Feb 27 02:07:35 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "cinder-086267d4-9395-4c9c-944c-c4bc3403d864-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-086267d4-9395-4c9c-944c-c4bc3403d864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "cinder-quobyte-086267d4-9395-4c9c-944c-c4bc3403d864" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0b000a70-f78c-4087-9711-e8cb7cc2a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1dd1dc-88c4-44a4-9f57-c834b5dbd7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-086267d4-9395-4c9c-944c-c4bc3403d864" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Deleting offline snapshot 086267d4-9395-4c9c-944c-c4bc3403d864 of volume 82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] snapshot_file for this snap is: volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c7e39b-74e0-4f0a-877e-b073c7499b80]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1dd1dc-88c4-44a4-9f57-c834b5dbd7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095320381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f38b19-c962-4a58-a902-2bec5c18422d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1ec98454-7acb-4546-beec-40afb7176676,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:36Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0d0b5d-23de-4bf0-a98f-063666c7058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b0d0b5d-23de-4bf0-a98f-063666c7058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cea4fd-615f-49b7-8eed-3dec52bafc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cea4fd-615f-49b7-8eed-3dec52bafc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22f38b19-c962-4a58-a902-2bec5c18422d', 'volume_name': 'volume-22f38b19-c962-4a58-a902-2bec5c18422d', 'volume_size': 1, 'source_volid': '1ec98454-7acb-4546-beec-40afb7176676', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db78009-6e0f-48f6-b3aa-9a40a963d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db78009-6e0f-48f6-b3aa-9a40a963d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee5093c-458b-431d-9227-414a4b733ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:35 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Volume 22f38b19-c962-4a58-a902-2bec5c18422d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22f38b19-c962-4a58-a902-2bec5c18422d', 'volume_size': 1, 'source_volid': '1ec98454-7acb-4546-beec-40afb7176676', 'source_volstatus': 'available'} Feb 27 02:07:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:35 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:35 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f 1G" returned: 0 in 0.867s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7362991d-27b6-481b-a60b-31cfbdd66f99 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7362991d-27b6-481b-a60b-31cfbdd66f99 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f Feb 27 02:07:36 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.617s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec5902-a385-468f-8a05-126a43a9e491]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7362991d-27b6-481b-a60b-31cfbdd66f99 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f" returned: 0 in 0.541s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f is being set with open permissions: ugo+rw Feb 27 02:07:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d Feb 27 02:07:36 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f Feb 27 02:07:36 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f" returned: 0 in 0.441s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info Feb 27 02:07:37 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:37 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info" returned: 0 in 0.475s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info is being set with open permissions: ugo+rw Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info Feb 27 02:07:37 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.542s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864 Feb 27 02:07:37 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:38 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.info" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.637s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.116s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:38 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Cloning volume 1ec98454-7acb-4546-beec-40afb7176676 to volume 22f38b19-c962-4a58-a902-2bec5c18422d Feb 27 02:07:38 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d.086267d4-9395-4c9c-944c-c4bc3403d864" returned: 0 in 0.502s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-52af9dbc-2d4a-4db7-9762-42dfc6342995 tempest-SnapshotMetadataTestJSON-644215278 None] Create snapshot completed successfully Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Creating offline snapshot 8819d4e0-1edd-4235-b819-06309a5b18e0 of volume 1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-086267d4-9395-4c9c-944c-c4bc3403d864" released by "_delete_snapshot" :: held 2.314s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_snapshot" :: held 2.346s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8efc3c-ce48-4620-a2a9-13df61c7e00c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Created reservations ['d1715f1e-11c8-4c01-8ef7-b7941d8030c1', '9df6ba60-ce50-4c14-975e-50cd06c7e4f5', 'deeb1997-5cea-4788-8072-10818c8e9f95', 'b207c0e2-840e-4601-afd2-680c22c658ed'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:38 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Delete snapshot completed successfully. Feb 27 02:07:38 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b552721e-66e3-44b6-ae68-aaa1eb00d3c9 tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-086267d4-9395-4c9c-944c-c4bc3403d864-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:38 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.827s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 1G Feb 27 02:07:39 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "cinder-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" acquired by "delete_volume" :: waited 0.035s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3f01f-260d-40ed-bda8-1cf8fb3002ea]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d Feb 27 02:07:39 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "cinder-ade103d6-e210-4d67-bbad-5a85e749168f-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-ade103d6-e210-4d67-bbad-5a85e749168f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "cinder-quobyte-ade103d6-e210-4d67-bbad-5a85e749168f" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:40 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 1G" returned: 0 in 1.363s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec98454-7acb-4546-beec-40afb7176676 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-ade103d6-e210-4d67-bbad-5a85e749168f" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Deleting offline snapshot ade103d6-e210-4d67-bbad-5a85e749168f of volume 7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:40 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec98454-7acb-4546-beec-40afb7176676 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:40 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] snapshot_file for this snap is: volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[756484cb-49bc-4684-8825-89a863fe63a9]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f Feb 27 02:07:40 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" returned: 0 in 1.053s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d Feb 27 02:07:40 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec98454-7acb-4546-beec-40afb7176676 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 1.052s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 is being set with open permissions: ugo+rw Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:41 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" returned: 0 in 1.008s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-quobyte-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d" released by "delete_volume" :: held 2.270s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:41 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f" returned: 0 in 1.235s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7362991d-27b6-481b-a60b-31cfbdd66f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc794e18-4a9c-47bc-8612-3a0bff284d83]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Created reservations ['3629daf9-e4fd-49e9-b7db-7f22585a3ead', '814319b0-6622-4cae-9f92-9a7f7329473e', '5407cab5-d3b7-42c0-b204-ec03125c5891', 'f50db095-3e5f-4217-8c1f-29612ef97c6d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 Feb 27 02:07:41 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:41 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 0.860s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info Feb 27 02:07:42 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.662s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Deleted volume successfully. Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-99b4e6c9-191e-4ca1-b201-f68df7aa6bbe tempest-SnapshotsActionsTest-1422186922 None] Lock "cinder-82ebb033-dd9b-43c9-baa9-c8a1b0248a9d-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:42 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99" returned: 0 in 1.154s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f Feb 27 02:07:42 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info" returned: 0 in 0.612s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info is being set with open permissions: ugo+rw Feb 27 02:07:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info Feb 27 02:07:42 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f" returned: 0 in 0.611s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f Feb 27 02:07:43 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.info" returned: 0 in 0.728s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] snapshot: 8819d4e0-1edd-4235-b819-06309a5b18e0, volume: 22f38b19-c962-4a58-a902-2bec5c18422d, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[65751103-1357-42af-88a6-1198ea30caf7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:43 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99.ade103d6-e210-4d67-bbad-5a85e749168f" returned: 0 in 0.736s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-ade103d6-e210-4d67-bbad-5a85e749168f" released by "_delete_snapshot" :: held 3.895s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" released by "delete_snapshot" :: held 3.952s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Created reservations ['c0083864-d463-43de-b605-27b1c08d8cdd', '998e8422-0241-4b89-aaae-f1553b912282', 'f87adbde-02b5-4fd7-ab0d-1ad828d1f3c7', '262a655b-2886-456a-ab57-e5c3282f7376'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:44 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Delete snapshot completed successfully. Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-85d6ce74-f3bd-4724-a25d-74d113f0e797 tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-ade103d6-e210-4d67-bbad-5a85e749168f-delete_snapshot" released by "delete_snapshot" :: held 4.145s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "cinder-7362991d-27b6-481b-a60b-31cfbdd66f99-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-7362991d-27b6-481b-a60b-31cfbdd66f99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 1.009s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec98454-7acb-4546-beec-40afb7176676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2e013-5d26-4e93-93a6-7327c87bea85]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2870567-a021-4519-b47c-42534b50b03a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:07:44 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 Feb 27 02:07:44 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99" returned: 0 in 0.733s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99 Feb 27 02:07:45 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.857s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d Feb 27 02:07:45 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7362991d-27b6-481b-a60b-31cfbdd66f99" returned: 0 in 0.830s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-quobyte-7362991d-27b6-481b-a60b-31cfbdd66f99" released by "delete_volume" :: held 1.620s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Created reservations ['0cba7c23-e94b-445a-a46d-7a5af8e6e94f', '997041a0-eeea-4a55-9237-5c52bdf0889a', '9c313cfa-0ae1-4c4f-88ef-7c510dba21fd', '7d257137-d0ec-49de-ab53-da2f0571f6b5'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:46 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 2.376s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:49 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Deleted volume successfully. Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-47725489-023e-4a5e-889b-36bcc95beeda tempest-SnapshotMetadataTestJSON-644215278 None] Lock "cinder-7362991d-27b6-481b-a60b-31cfbdd66f99-delete_volume" released by "delete_volume" :: held 4.584s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:49 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d" returned: 0 in 3.748s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e917ffa-17b8-4429-b2fa-79783b935c32]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:07:49 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Flow 'volume_create_manager' (5cfd9b86-e880-4e7f-80a7-c88acba6604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb22eaab-7f5c-4707-ae7a-4db3da1bd8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb22eaab-7f5c-4707-ae7a-4db3da1bd8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1778599803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1e82d3-1e6b-43ea-9665-78270ff84bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac1ed88a8784411b5682fae32ae5d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:50Z,use_quota=True,user_id='0e9c4b9de0934ddc98ebd1c8a8f551ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3711ca21-5f28-47da-9322-652c210a401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3711ca21-5f28-47da-9322-652c210a401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e8cb92-7181-4430-a641-0b8317e65fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e8cb92-7181-4430-a641-0b8317e65fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1e82d3-1e6b-43ea-9665-78270ff84bc9', 'volume_name': 'volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c41a922-0e6d-46ff-99f0-1da025cf2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c41a922-0e6d-46ff-99f0-1da025cf2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad290032-6629-4e4d-a9cd-a9231f343c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:49 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Volume 2a1e82d3-1e6b-43ea-9665-78270ff84bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9', 'volume_size': 1} Feb 27 02:07:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.906s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676, size 1024.00 MB, duration 3.75 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:50 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Converted 1024.00 MB image at 273.16 MB/s Feb 27 02:07:50 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d is being set with open permissions: ugo+rw Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d Feb 27 02:07:50 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Flow 'volume_create_manager' (436ab2e3-f388-4470-b667-b8b85332fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081f20c1-7d67-41b8-b0f7-6b254dbeb866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081f20c1-7d67-41b8-b0f7-6b254dbeb866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-944858374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bad4aa-e079-48bc-b181-4d1ee7d34fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59b1995b1104896aca81f7ded8ab21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='f5b7deed328843158d956302e0a4b9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9b56912-9eb4-427e-b40a-29400d1dc9a8),volume_type_id=b9b56912-9eb4-427e-b40a-29400d1dc9a8)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad89407-3ebb-45f3-9a07-d44d4c121aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad89407-3ebb-45f3-9a07-d44d4c121aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4380acaa-9b27-4a90-ad34-0f2b3277b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4380acaa-9b27-4a90-ad34-0f2b3277b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bad4aa-e079-48bc-b181-4d1ee7d34fe1', 'volume_name': 'volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcd19b-3834-4d41-a1cd-f6cacd127391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fcd19b-3834-4d41-a1cd-f6cacd127391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6efd81-802e-4c0b-99cc-3bf03983c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Volume b4bad4aa-e079-48bc-b181-4d1ee7d34fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1', 'volume_size': 1} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d" returned: 0 in 0.642s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" released by "_copy_volume_from_snapshot" :: held 7.231s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-8819d4e0-1edd-4235-b819-06309a5b18e0" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-8819d4e0-1edd-4235-b819-06309a5b18e0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Deleting offline snapshot 8819d4e0-1edd-4235-b819-06309a5b18e0 of volume 1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] snapshot_file for this snap is: volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ac2bc7-8489-404e-802a-ab0cbcfc70d3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:51 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 0.605s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec98454-7acb-4546-beec-40afb7176676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c60e12-4c77-43ab-a3b7-127645b88a1e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:07:51 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Flow 'volume_create_manager' (e17a13b4-a154-4fe7-a48c-770b62adff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5740b3b0-1332-48e6-8d6d-3ba3a5070ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5740b3b0-1332-48e6-8d6d-3ba3a5070ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-236055711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b653cb0a-5a4e-4b97-8cb3-329168e4c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae32790d7f46e6a603ebb5a071e050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:52Z,use_quota=True,user_id='6642ab5e3c4c4ca49a55212d4066c9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c14fc46-ecad-4f7b-bdf3-55a7108e2c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c14fc46-ecad-4f7b-bdf3-55a7108e2c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84c6865-a19a-425d-91ad-4907ca6e5980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84c6865-a19a-425d-91ad-4907ca6e5980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b653cb0a-5a4e-4b97-8cb3-329168e4c34a', 'volume_name': 'volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0e26f-5816-45e7-9dc4-6d1641ddc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c0e26f-5816-45e7-9dc4-6d1641ddc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d86849-54e9-42df-8d50-aa1ca7aa9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Volume b653cb0a-5a4e-4b97-8cb3-329168e4c34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a', 'volume_size': 1} Feb 27 02:07:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:52 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.535s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:52 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 0.527s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0 Feb 27 02:07:52 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676.8819d4e0-1edd-4235-b819-06309a5b18e0" returned: 0 in 0.473s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-8819d4e0-1edd-4235-b819-06309a5b18e0" released by "_delete_snapshot" :: held 2.214s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.061s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.311s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1778599803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1e82d3-1e6b-43ea-9665-78270ff84bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac1ed88a8784411b5682fae32ae5d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:50Z,use_quota=True,user_id='0e9c4b9de0934ddc98ebd1c8a8f551ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Creating volume 2a1e82d3-1e6b-43ea-9665-78270ff84bc9 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:53 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee5093c-458b-431d-9227-414a4b733ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f38b19-c962-4a58-a902-2bec5c18422d', 'volume_size': 1, 'source_volid': '1ec98454-7acb-4546-beec-40afb7176676', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:53 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 1073741824 Feb 27 02:07:53 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6d2835-1835-4a6c-95de-fd418f1b8f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Volume volume-22f38b19-c962-4a58-a902-2bec5c18422d (22f38b19-c962-4a58-a902-2bec5c18422d): created successfully Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6d2835-1835-4a6c-95de-fd418f1b8f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0b000a70-f78c-4087-9711-e8cb7cc2a44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f3b4700b-6aee-4042-a545-205faeee1ceb tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:07:53 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 1073741824" returned: 0 in 0.671s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 Feb 27 02:07:53 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (9d09a8fd-7b12-415f-a566-0b930467bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6186a558-6182-4b5d-86bb-d3f122feb058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6186a558-6182-4b5d-86bb-d3f122feb058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1530390619',display_name='tempest-VolumesGetTest-Volume-542585302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4093333a-f11b-427c-963f-6721e16ee4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4093333a-f11b-427c-963f-6721e16ee4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc6795c-d01d-4497-8450-242c1ef20887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc6795c-d01d-4497-8450-242c1ef20887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2', 'volume_name': 'volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcd33e6-17d2-441f-89bc-9b41b56fa42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcd33e6-17d2-441f-89bc-9b41b56fa42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e62b00d-78ec-4278-a9a3-b2d8011da4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Volume 74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2', 'volume_size': 1} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:54 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" returned: 0 in 0.559s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.631s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-944858374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bad4aa-e079-48bc-b181-4d1ee7d34fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d59b1995b1104896aca81f7ded8ab21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='f5b7deed328843158d956302e0a4b9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9b56912-9eb4-427e-b40a-29400d1dc9a8),volume_type_id=b9b56912-9eb4-427e-b40a-29400d1dc9a8)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Creating volume b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:54 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad290032-6629-4e4d-a9cd-a9231f343c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a413b1-e441-4f84-8ffe-02241e4960b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:54 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 1073741824 Feb 27 02:07:54 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Volume volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 (2a1e82d3-1e6b-43ea-9665-78270ff84bc9): created successfully Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a413b1-e441-4f84-8ffe-02241e4960b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Flow 'volume_create_manager' (5cfd9b86-e880-4e7f-80a7-c88acba6604b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:54 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-eccf5131-242e-4638-b0b6-c7edc8513ace tempest-ServersNegativeTestJSON-1026296555 None] Created volume successfully. Feb 27 02:07:55 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 1073741824" returned: 0 in 0.640s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=176,cinder:DELETE=11,cinder:SELECT=130,cinder:INSERT=35 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=132,cinder:UPDATE=128,cinder:INSERT=41,cinder:DELETE=15 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 Feb 27 02:07:55 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" returned: 0 in 0.576s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.792s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-236055711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b653cb0a-5a4e-4b97-8cb3-329168e4c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dae32790d7f46e6a603ebb5a071e050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:52Z,use_quota=True,user_id='6642ab5e3c4c4ca49a55212d4066c9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Creating volume b653cb0a-5a4e-4b97-8cb3-329168e4c34a {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:55 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6efd81-802e-4c0b-99cc-3bf03983c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1ceef9-65a2-49a6-b567-0e2c3795d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:55 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a 1073741824 Feb 27 02:07:55 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Volume volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 (b4bad4aa-e079-48bc-b181-4d1ee7d34fe1): created successfully Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1ceef9-65a2-49a6-b567-0e2c3795d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Flow 'volume_create_manager' (436ab2e3-f388-4470-b667-b8b85332fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-856bc2ad-c22b-4a22-a899-a208fd420104 tempest-VolumeTypesAccessTest-309756097 None] Created volume successfully. Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Acquiring lock "cinder-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "cinder-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Flow 'volume_create_manager' (ac74ee1d-ed04-403f-a013-b8502b4807fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae70b15-8b95-49f4-98b2-ed3c9bc7ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae70b15-8b95-49f4-98b2-ed3c9bc7ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-103481930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a833d7a-3545-4099-8363-d054678a46e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac1ed88a8784411b5682fae32ae5d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:56Z,use_quota=True,user_id='0e9c4b9de0934ddc98ebd1c8a8f551ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e2ddb1-d253-4904-8cd9-a6ed084dcf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e2ddb1-d253-4904-8cd9-a6ed084dcf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851b4e53-034f-41d2-a31a-0c2225b9ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851b4e53-034f-41d2-a31a-0c2225b9ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a833d7a-3545-4099-8363-d054678a46e4', 'volume_name': 'volume-1a833d7a-3545-4099-8363-d054678a46e4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d289d73-9cf4-4ad4-ba57-730b8fca635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d289d73-9cf4-4ad4-ba57-730b8fca635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dcfe8d-07d8-4424-b602-4126952d0752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Volume 1a833d7a-3545-4099-8363-d054678a46e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a833d7a-3545-4099-8363-d054678a46e4', 'volume_size': 1} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:56 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Acquiring lock "cinder-quobyte-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a 1073741824" returned: 0 in 0.708s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "cinder-quobyte-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[db942881-1358-45d7-a2cd-cafc78e5b42d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a Feb 27 02:07:56 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 Feb 27 02:07:56 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" returned: 0 in 0.428s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1530390619',display_name='tempest-VolumesGetTest-Volume-542585302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Creating volume 74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:56 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d86849-54e9-42df-8d50-aa1ca7aa9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 1073741824 Feb 27 02:07:56 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92003ad-1e3f-4555-881f-def40e73e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Volume volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a (b653cb0a-5a4e-4b97-8cb3-329168e4c34a): created successfully Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92003ad-1e3f-4555-881f-def40e73e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Flow 'volume_create_manager' (e17a13b4-a154-4fe7-a48c-770b62adff44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e92f8d2b-6d23-4e5e-9eb8-a81a2d659b3f tempest-AbsoluteLimitsTests-8990742 None] Created volume successfully. Feb 27 02:07:57 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1 Feb 27 02:07:57 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Acquiring lock "cinder-b653cb0a-5a4e-4b97-8cb3-329168e4c34a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "cinder-b653cb0a-5a4e-4b97-8cb3-329168e4c34a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Acquiring lock "cinder-quobyte-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "cinder-quobyte-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe57027-2ca2-4d6e-b041-b4e4503a5cbe]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 1073741824" returned: 0 in 0.749s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a Feb 27 02:07:57 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 Feb 27 02:07:57 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" returned: 0 in 0.717s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "cinder-quobyte-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1" released by "delete_volume" :: held 1.331s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:57 devstack cinder-volume[83211]: WARNING cinder.quota [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1995913580 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1995913580, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:57 devstack cinder-volume[83211]: WARNING cinder.quota [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1995913580 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1995913580, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Created reservations ['3c866545-50c1-4e2c-ab2c-b4c912564a53', '9ca259a0-311f-47c0-989f-b1f5dfe7b8fa', '5b272d98-0d67-43b3-a28a-1a80e1313fb7', '597aa760-92e6-4c47-9cb2-f5f98bada85e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:57 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" returned: 0 in 0.540s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-103481930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a833d7a-3545-4099-8363-d054678a46e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac1ed88a8784411b5682fae32ae5d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:56Z,use_quota=True,user_id='0e9c4b9de0934ddc98ebd1c8a8f551ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Creating volume 1a833d7a-3545-4099-8363-d054678a46e4 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:58 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:58 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e62b00d-78ec-4278-a9a3-b2d8011da4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952ab75-7a39-48d6-9956-b4658a7c9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 1073741824 Feb 27 02:07:58 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" returned: 0 in 0.688s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Volume volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 (74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2): created successfully Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9952ab75-7a39-48d6-9956-b4658a7c9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a Feb 27 02:07:58 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (9d09a8fd-7b12-415f-a566-0b930467bab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3c9628e5-c62c-4404-a374-3dc6d84c5271 tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:07:58 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.641s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Deleted volume successfully. Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fc90105d-f54f-43e7-9849-c7f36ed93b74 tempest-VolumeTypesAccessTest-309756097 None] Lock "cinder-b4bad4aa-e079-48bc-b181-4d1ee7d34fe1-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "cinder-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0424d96-ea0e-4c85-af49-12897864e45a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" returned: 0 in 0.717s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "cinder-quobyte-b653cb0a-5a4e-4b97-8cb3-329168e4c34a" released by "delete_volume" :: held 1.431s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 Feb 27 02:07:59 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Created reservations ['efaeb603-a5dd-4fe6-88b9-bf34e1bf627c', 'd6d7646e-745e-430e-bf5d-3b4e067cdba1', '99cde556-8a0c-4e04-af41-c17ea8c2f5fa', '8c8a886c-9e97-4f0e-9432-5d4866ddd538'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:59 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 1073741824" returned: 0 in 0.859s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 Feb 27 02:07:59 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:07:59 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4" returned: 0 in 0.549s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dcfe8d-07d8-4424-b602-4126952d0752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a833d7a-3545-4099-8363-d054678a46e4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3520165-17b1-4de3-b2ce-ca3be80a0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Volume volume-1a833d7a-3545-4099-8363-d054678a46e4 (1a833d7a-3545-4099-8363-d054678a46e4): created successfully Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3520165-17b1-4de3-b2ce-ca3be80a0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Flow 'volume_create_manager' (ac74ee1d-ed04-403f-a013-b8502b4807fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:59 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d9dad57a-a85f-47f7-9f3e-2f98eb929bca tempest-ServersNegativeTestJSON-1026296555 None] Created volume successfully. Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" returned: 0 in 0.841s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.603s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Deleted volume successfully. Feb 27 02:07:59 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2 Feb 27 02:07:59 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a0ac81b2-8e84-4d59-b789-363312bf2bc3 tempest-AbsoluteLimitsTests-8990742 None] Lock "cinder-b653cb0a-5a4e-4b97-8cb3-329168e4c34a-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:00 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" returned: 0 in 0.602s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2" released by "delete_volume" :: held 1.470s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Created reservations ['14168826-9cd1-41b6-997f-983a6a299809', 'f107222c-4509-43d4-9d8e-6ba11fbb37b6', '4f567a84-8e99-4e74-ba36-2cd7f021ee13', 'd4af0f1a-ae26-4dbc-9118-d78e5f30dc8e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:00 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-22f38b19-c962-4a58-a902-2bec5c18422d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "cinder-22f38b19-c962-4a58-a902-2bec5c18422d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.701s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" acquired by "delete_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6b7a837-0924-423c-a422-f542c1671fa4 tempest-VolumesGetTest-642185965 None] Lock "cinder-74bca4a0-7ca0-4a4d-81fa-9eb22c53c8b2-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5ca55b-2a3d-497d-b9da-80f73aa905ee]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d Feb 27 02:08:01 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "cinder-1a833d7a-3545-4099-8363-d054678a46e4-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-1a833d7a-3545-4099-8363-d054678a46e4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "cinder-quobyte-1a833d7a-3545-4099-8363-d054678a46e4" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-quobyte-1a833d7a-3545-4099-8363-d054678a46e4" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6114dd37-590f-464c-ac0f-73b6b2ba98ef]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 Feb 27 02:08:01 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d" returned: 0 in 0.773s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d Feb 27 02:08:02 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4" returned: 0 in 1.039s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4 Feb 27 02:08:02 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-22f38b19-c962-4a58-a902-2bec5c18422d" returned: 0 in 0.617s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-22f38b19-c962-4a58-a902-2bec5c18422d" released by "delete_volume" :: held 1.422s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Created reservations ['f06af26c-a546-4418-b67c-1c43c7d29320', '1f929e70-3a11-435a-83a9-4c38aa944cd1', '698a41bd-97e3-4d2e-bc22-d28fe2e8e7c7', '22241bfb-6dc2-4a55-ac5e-36d2a1f36df2'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:02 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a833d7a-3545-4099-8363-d054678a46e4" returned: 0 in 0.589s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-quobyte-1a833d7a-3545-4099-8363-d054678a46e4" released by "delete_volume" :: held 1.655s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Created reservations ['187f7f38-af2e-4c1e-a912-cfcc47e2f63b', '294f48e6-963b-4486-b16f-2e69adecfe31', 'c4cac5f8-94f8-42e7-a633-750ee270894a', '1bfbe4dd-098b-4c30-9e5a-8f0437527b03'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:03 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.607s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1bcb15a5-7b10-46a9-a145-e58bc6eba6ef tempest-VolumesGetTest-642185965 None] Lock "cinder-22f38b19-c962-4a58-a902-2bec5c18422d-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-1ec98454-7acb-4546-beec-40afb7176676-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "cinder-1ec98454-7acb-4546-beec-40afb7176676-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-1ec98454-7acb-4546-beec-40afb7176676" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-1ec98454-7acb-4546-beec-40afb7176676" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[25389d4f-9bdf-4dd6-a42f-6e0a1b49be19]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "cinder-2a1e82d3-1e6b-43ea-9665-78270ff84bc9-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-2a1e82d3-1e6b-43ea-9665-78270ff84bc9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "cinder-quobyte-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-quobyte-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:03 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:08:03 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb54fc5-a938-4506-8adc-a0bcd7030c5f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (f613ed62-a9d0-40cb-b4cb-7850a013ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5eec26-eaaf-44df-9457-056e6ef17afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5eec26-eaaf-44df-9457-056e6ef17afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1490521724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2e2d6d-2846-417e-86eb-990c9161f5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3ea74116d24f5d9e49633e05a01721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:04Z,use_quota=True,user_id='5c67258d47fa4a45a1cd6ea286b4c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addbfa6c-bc6c-4263-b799-41f3d44a146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addbfa6c-bc6c-4263-b799-41f3d44a146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f66ff53-8764-47fd-b84c-a540009121da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f66ff53-8764-47fd-b84c-a540009121da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2e2d6d-2846-417e-86eb-990c9161f5c4', 'volume_name': 'volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e88332-8264-4bbf-b805-63891976c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e88332-8264-4bbf-b805-63891976c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a446f0-f97e-4fc2-85b4-2c835122c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4', 'volume_size': 1} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1490521724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2e2d6d-2846-417e-86eb-990c9161f5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3ea74116d24f5d9e49633e05a01721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:04Z,use_quota=True,user_id='5c67258d47fa4a45a1cd6ea286b4c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Creating volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:03 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.784s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Deleted volume successfully. Feb 27 02:08:04 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 1073741824 Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d9b8e36e-eafa-41b8-a2bd-d0cc84a839fa tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-1a833d7a-3545-4099-8363-d054678a46e4-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:04 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.680s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676 Feb 27 02:08:04 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" returned: 0 in 0.724s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9 Feb 27 02:08:04 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 1073741824" returned: 0 in 0.734s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:04 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1ec98454-7acb-4546-beec-40afb7176676" returned: 0 in 0.612s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-1ec98454-7acb-4546-beec-40afb7176676" released by "delete_volume" :: held 1.342s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:04 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Created reservations ['96e06bbe-079f-4fb0-9fc3-22c7f30e0269', 'b132a93b-fc43-4a72-8431-a95ddd076f40', 'fcd65a51-0e08-46c0-ab63-ae70b5c59b67', 'f22fa150-0af1-43bd-adf2-e1ff078d3433'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:05 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-quobyte-2a1e82d3-1e6b-43ea-9665-78270ff84bc9" released by "delete_volume" :: held 1.317s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Created reservations ['f14ca7d2-7849-45e3-9875-67ac174b46d4', '02935a57-a3d6-444a-9e7e-ca324085a024', 'e437600f-cbc2-4161-9bb6-2aca6a486860', 'c4cd90f1-1987-4f2c-8e8f-81b7f5653082'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:05 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.556s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a446f0-f97e-4fc2-85b4-2c835122c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237fe8a-b106-486a-a029-66c605b049c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:05 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Volume volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 (3c2e2d6d-2846-417e-86eb-990c9161f5c4): created successfully Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237fe8a-b106-486a-a029-66c605b049c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (f613ed62-a9d0-40cb-b4cb-7850a013ba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6ad5acd1-85e8-4541-99ad-ceb535e984f2 tempest-VolumesDeleteCascade-2131914936 None] Created volume successfully. Feb 27 02:08:05 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.589s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86dcf0b9-11ea-4262-a941-2288f593ae69 tempest-VolumesGetTest-642185965 None] Lock "cinder-1ec98454-7acb-4546-beec-40afb7176676-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:05 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.650s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Deleted volume successfully. Feb 27 02:08:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b202728c-3305-4fe9-947a-c46ad9767dd5 tempest-ServersNegativeTestJSON-1026296555 None] Lock "cinder-2a1e82d3-1e6b-43ea-9665-78270ff84bc9-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Creating offline snapshot 049a8738-06f2-4e32-885d-8fdc7a55ae8a of volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[daacd6b8-3d00-40be-9755-ed8ebaefa720]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:06 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (32fd75be-f5b0-4f21-838f-d9eec9a3d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c63565-0e27-437e-821b-6742406b1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c63565-0e27-437e-821b-6742406b1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308189104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:06Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fdad65-2f7b-46fc-8245-e5b074810263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fdad65-2f7b-46fc-8245-e5b074810263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e080e507-e8b2-49bb-b408-d36ef3f8b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.image.glance [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Creating Keystone auth plugin from conf {{(pid=83211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e080e507-e8b2-49bb-b408-d36ef3f8b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26', 'volume_name': 'volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0089254-fcfb-4e11-aa4e-d5f1f8a88a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0089254-fcfb-4e11-aa4e-d5f1f8a88a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4a294a-a0c9-435f-a785-4122fbe98712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:08:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Trying to clone 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]). {{(pid=83211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:08:07 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.705s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a 1G Feb 27 02:08:07 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:08:07 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d0212-d59b-4392-ad65-1f42e9dabef4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD Feb 27 02:08:07 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a 1G" returned: 0 in 0.808s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:07 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 is fetched for user 7a68ca51e9b84a1fb54259b1396ce2ff. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdb7497-c6b3-4b60-8af2-5ee9496b9ef8]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD Feb 27 02:08:08 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.625s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a is being set with open permissions: ugo+rw Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:08 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.752s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info Feb 27 02:08:09 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info is being set with open permissions: ugo+rw Feb 27 02:08:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info Feb 27 02:08:09 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.info" returned: 0 in 0.468s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.058s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-308189104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:06Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Creating volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:10 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1073741824 Feb 27 02:08:10 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f48effff-6897-4f58-a038-905a0a909a97 tempest-VolumesDeleteCascade-2131914936 None] Create snapshot completed successfully Feb 27 02:08:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:11 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1073741824" returned: 0 in 0.687s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:11 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 0 in 0.492s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Creating offline snapshot 376ac34e-4aa9-49a1-8693-370f67a7f828 of volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d1ac8-24ac-4c91-8e91-41e7c5171ab5]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Attempting download of 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5ba0d-77ec-4b7d-8a93-214d3d83c871]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:11 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1 Feb 27 02:08:11 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1" returned: 0 in 0.538s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.638s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 1G Feb 27 02:08:12 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1 Feb 27 02:08:12 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1" returned: 1 in 0.523s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_hp04opw1' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546b2a5-4dec-4bf1-912e-f15f8fea3100]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD Feb 27 02:08:12 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 1G" returned: 0 in 0.736s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:13 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] 362137d4-09ea-4da7-92c5-9fdbd53eaec8 was qcow2, converting to raw {{(pid=83211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:13 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:13 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.550s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 is being set with open permissions: ugo+rw Feb 27 02:08:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:13 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.561s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:14 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.534s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:14 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c0f98f3f-e8d4-4741-b344-f5ec7f3b4cf2 tempest-VolumesDeleteCascade-2131914936 None] Create snapshot completed successfully Feb 27 02:08:14 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 0 in 1.267s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_of1osa2udevstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:14 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Converted 112.00 MB image at 88.30 MB/s Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1G Feb 27 02:08:14 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-3c2e2d6d-2846-417e-86eb-990c9161f5c4-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-3c2e2d6d-2846-417e-86eb-990c9161f5c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Performing cascade delete. {{(pid=83211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-049a8738-06f2-4e32-885d-8fdc7a55ae8a-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-049a8738-06f2-4e32-885d-8fdc7a55ae8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-049a8738-06f2-4e32-885d-8fdc7a55ae8a" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-049a8738-06f2-4e32-885d-8fdc7a55ae8a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Deleting offline snapshot 049a8738-06f2-4e32-885d-8fdc7a55ae8a of volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] snapshot_file for this snap is: volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d8797-50aa-46e4-8625-84cf06360d7a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:15 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 1G" returned: 0 in 0.557s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9e4414-7d45-46a9-9c29-52df90de29ae]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:15 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.601s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b1459-3ed0-4fb1-8402-e093c919c5b3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:15 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 0 in 0.601s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:15 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.611s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[404089b4-9447-4aa9-8db6-f94487787c91]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:16 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 1 in 0.617s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Downloaded image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 successfully. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 for user 7a68ca51e9b84a1fb54259b1396ce2ff is deleted. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Marking volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 as bootable. {{(pid=83211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Copying metadata from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 to 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26. {{(pid=83211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Creating volume glance metadata for volume 2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 backed by image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4a294a-a0c9-435f-a785-4122fbe98712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90eb645-1f25-477a-916f-6f0a651def3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Volume volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 (2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26): created successfully Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90eb645-1f25-477a-916f-6f0a651def3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (32fd75be-f5b0-4f21-838f-d9eec9a3d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-633e5cc3-f176-4528-9140-f9daa3582fee tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:08:16 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.628s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac836b1-aed9-4b5e-a70b-35593af0a9aa]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:17 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.804s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4eec5-9450-4446-b1ad-818b25e6a723]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0e31153f-2f46-4af7-9ff6-1008518a01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6f9670-ae77-4318-add2-efd316548428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:17 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6f9670-ae77-4318-add2-efd316548428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-143360401',display_name='tempest-VolumesGetTest-Volume-126746093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda3fdc1-616c-4e79-9887-67edc7faad39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:18Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ca3c85-abcb-47f3-a6f3-8e980b9bd79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ca3c85-abcb-47f3-a6f3-8e980b9bd79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceaa224-0594-43eb-b4d8-e8cc551601ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceaa224-0594-43eb-b4d8-e8cc551601ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda3fdc1-616c-4e79-9887-67edc7faad39', 'volume_name': 'volume-fda3fdc1-616c-4e79-9887-67edc7faad39', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922374c2-6413-4b4e-9608-d77dd4994e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922374c2-6413-4b4e-9608-d77dd4994e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0f35ed-a2a0-4c91-8857-c77d88e4006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Volume fda3fdc1-616c-4e79-9887-67edc7faad39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda3fdc1-616c-4e79-9887-67edc7faad39', 'volume_size': 1} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-143360401',display_name='tempest-VolumesGetTest-Volume-126746093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda3fdc1-616c-4e79-9887-67edc7faad39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b92dc1b290e4b0080a6ea8c9f51e55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:18Z,use_quota=True,user_id='7a68ca51e9b84a1fb54259b1396ce2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Creating volume fda3fdc1-616c-4e79-9887-67edc7faad39 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:17 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 1073741824 Feb 27 02:08:17 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:18 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 1073741824" returned: 0 in 0.665s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 Feb 27 02:08:18 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.736s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a Feb 27 02:08:19 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39" returned: 0 in 0.739s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0f35ed-a2a0-4c91-8857-c77d88e4006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda3fdc1-616c-4e79-9887-67edc7faad39', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfd3764-1321-4c1f-9b52-781a33e4ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Volume volume-fda3fdc1-616c-4e79-9887-67edc7faad39 (fda3fdc1-616c-4e79-9887-67edc7faad39): created successfully Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfd3764-1321-4c1f-9b52-781a33e4ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Flow 'volume_create_manager' (0e31153f-2f46-4af7-9ff6-1008518a01a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e3ee8a32-2825-4af6-b6ec-0688ed707ab1 tempest-VolumesGetTest-642185965 None] Created volume successfully. Feb 27 02:08:19 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.049a8738-06f2-4e32-885d-8fdc7a55ae8a" returned: 0 in 0.577s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 -F qcow2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 -F qcow2 Feb 27 02:08:19 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-fda3fdc1-616c-4e79-9887-67edc7faad39-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "cinder-fda3fdc1-616c-4e79-9887-67edc7faad39-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-fda3fdc1-616c-4e79-9887-67edc7faad39" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-fda3fdc1-616c-4e79-9887-67edc7faad39" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8a2fd-f014-49b0-90be-58026cd57067]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 -F qcow2" returned: 0 in 0.719s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-049a8738-06f2-4e32-885d-8fdc7a55ae8a" released by "_delete_snapshot" :: held 5.379s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" released by "delete_snapshot" :: held 5.392s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 Feb 27 02:08:20 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['4217c5c5-5282-4249-9daa-4ded4e756911', '0f0eef83-9f73-4ec5-915f-be3446ff708c', 'ac804ea3-5ee3-460e-bbfc-27130a8b0914', '0a2c88e9-3d8e-4eed-9823-d1fcb282ee63'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Delete snapshot completed successfully. Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-049a8738-06f2-4e32-885d-8fdc7a55ae8a-delete_snapshot" released by "delete_snapshot" :: held 5.594s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-376ac34e-4aa9-49a1-8693-370f67a7f828-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-376ac34e-4aa9-49a1-8693-370f67a7f828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-376ac34e-4aa9-49a1-8693-370f67a7f828" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-376ac34e-4aa9-49a1-8693-370f67a7f828" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Deleting offline snapshot 376ac34e-4aa9-49a1-8693-370f67a7f828 of volume 3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] snapshot_file for this snap is: volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ccb48f-7248-4eda-b3e6-9749c42a1738]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:20 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Flow 'volume_create_manager' (086e3195-7672-4433-967f-ebbf9fb541db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee6a449-c891-477f-8df6-5043c013f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee6a449-c891-477f-8df6-5043c013f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116317842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0a50b7-aba4-46d3-b872-05c1730dec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402ca72a0974f3181e65dbbb23ad4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:21Z,use_quota=True,user_id='1cef035790664680bbe893ddc2be6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55ede67-888f-4d31-bbeb-70e679b7cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55ede67-888f-4d31-bbeb-70e679b7cb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01baeb1e-c8a2-41b3-bae8-f2097e2451fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01baeb1e-c8a2-41b3-bae8-f2097e2451fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0a50b7-aba4-46d3-b872-05c1730dec02', 'volume_name': 'volume-eb0a50b7-aba4-46d3-b872-05c1730dec02', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac3beed-f6e0-4b6e-9e2a-3cf1508a648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac3beed-f6e0-4b6e-9e2a-3cf1508a648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241b2c59-6cae-44c6-a0c4-7e590b12079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Volume eb0a50b7-aba4-46d3-b872-05c1730dec02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0a50b7-aba4-46d3-b872-05c1730dec02', 'volume_size': 1} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-116317842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0a50b7-aba4-46d3-b872-05c1730dec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a402ca72a0974f3181e65dbbb23ad4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:21Z,use_quota=True,user_id='1cef035790664680bbe893ddc2be6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Creating volume eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:20 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 1073741824 Feb 27 02:08:20 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.687s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[80536017-82a5-4897-88c7-1ab6e9737136]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39" returned: 0 in 1.136s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39 Feb 27 02:08:21 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:21 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 1073741824" returned: 0 in 0.771s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 Feb 27 02:08:21 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fda3fdc1-616c-4e79-9887-67edc7faad39" returned: 0 in 0.528s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-fda3fdc1-616c-4e79-9887-67edc7faad39" released by "delete_volume" :: held 1.693s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Created reservations ['30a8f78b-4fd3-4631-8ffb-67eea519003f', '3669db1c-4aad-4fb1-8b55-6c4feca30920', '0ac61702-052a-4358-867c-457afd0fe32b', 'a52e5020-273a-44e0-b3ac-19b63e9d68b7'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:22 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.701s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:22 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:22 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02" returned: 0 in 0.627s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241b2c59-6cae-44c6-a0c4-7e590b12079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0a50b7-aba4-46d3-b872-05c1730dec02', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0bb9e5-3d37-47ad-a3db-780294f2ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Volume volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 (eb0a50b7-aba4-46d3-b872-05c1730dec02): created successfully Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0bb9e5-3d37-47ad-a3db-780294f2ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Flow 'volume_create_manager' (086e3195-7672-4433-967f-ebbf9fb541db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-1e17535f-c040-48f3-923a-844567306692 req-4ef45006-6aa3-40c8-a0e1-2e1eebecdf56 tempest-VolumesSnapshotsTestJSON-823851361 None] Created volume successfully. Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "cinder-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Acquiring lock "cinder-quobyte-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[27970045-a75f-41a3-a0cd-b17f34320f2b]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:22 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.748s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828 Feb 27 02:08:22 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.789s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:08:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a7210ec7-59dc-4fc0-bd5c-7ad8a86c0e14 tempest-VolumesGetTest-642185965 None] Lock "cinder-fda3fdc1-616c-4e79-9887-67edc7faad39-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:23 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 0 in 0.674s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Creating offline snapshot 11a12591-e295-4786-ba1f-aa529ea7ddf5 of volume eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:23 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a95a72-0cbf-4a9f-8804-194e07e9f146]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:23 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4.376ac34e-4aa9-49a1-8693-370f67a7f828" returned: 0 in 0.714s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-376ac34e-4aa9-49a1-8693-370f67a7f828" released by "_delete_snapshot" :: held 2.962s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" released by "delete_snapshot" :: held 2.981s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:23 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 Feb 27 02:08:23 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['ce440b70-e938-41df-8ec5-a79c25b2dfb9', '30d6e05d-96fb-4455-bfa7-f7c080be3242', '43ed0aea-fff0-4d34-9838-db4fecfa4744', 'bcf78240-c6da-4e96-9653-690052fb3f57'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:23 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Delete snapshot completed successfully. Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-376ac34e-4aa9-49a1-8693-370f67a7f828-delete_snapshot" released by "delete_snapshot" :: held 3.167s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Snapshots deleted, issuing volume delete {{(pid=83211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b39dc9-fb62-4769-9d1a-64089f7524a4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:23 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 1 in 0.761s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26 Feb 27 02:08:24 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02" returned: 0 in 0.764s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 1G Feb 27 02:08:24 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.685s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4 Feb 27 02:08:24 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "cinder-quobyte-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26" released by "delete_volume" :: held 2.074s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Created reservations ['600eeb22-06fd-461e-9d47-964a21a08746', 'd9e6e83f-4b54-4e80-94d4-e74fd4582dd7', 'bf7184c1-139e-4f30-910d-cbc379635a36', '0ba803ad-98d0-4e74-88e4-843b9c591e5d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:24 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3c2e2d6d-2846-417e-86eb-990c9161f5c4" returned: 0 in 0.611s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 1G" returned: 0 in 0.797s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-3c2e2d6d-2846-417e-86eb-990c9161f5c4" released by "delete_volume" :: held 1.336s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 Feb 27 02:08:25 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['ad3131bd-9063-4e0c-bec9-c0da20084489', '66b03bd2-c715-4315-9ffe-e03a461de995', '4ebc67c0-fc69-424e-82de-52067fe3bd63', '787a8755-75dd-40dc-a140-f62537282d43'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:25 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Deleted volume successfully. Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-915b21c3-a225-4787-838b-0e5647b5fd82 tempest-VolumesGetTest-642185965 None] Lock "cinder-2eb1d7b2-cf6e-4e7f-8423-0af88fcf1b26-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:25 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5" returned: 0 in 0.530s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 is being set with open permissions: ugo+rw Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 Feb 27 02:08:25 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.467s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Deleted volume successfully. Feb 27 02:08:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0c9c7822-112e-4b9b-b572-28d203d16c76 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-3c2e2d6d-2846-417e-86eb-990c9161f5c4-delete_volume" released by "delete_volume" :: held 10.795s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:26 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5" returned: 0 in 0.556s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info Feb 27 02:08:26 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (8bec76f0-556d-4d51-89c4-1b736cf7d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5b926f-b141-49e2-b30f-378f25b4a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5b926f-b141-49e2-b30f-378f25b4a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1562265941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c30d32-1658-4864-b91e-3a86cc4f167a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3ea74116d24f5d9e49633e05a01721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:26Z,use_quota=True,user_id='5c67258d47fa4a45a1cd6ea286b4c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13208128-8062-48d3-8b10-41f3757426c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13208128-8062-48d3-8b10-41f3757426c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9c839-cc22-4b4a-8139-48be80dccdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9c839-cc22-4b4a-8139-48be80dccdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c30d32-1658-4864-b91e-3a86cc4f167a', 'volume_name': 'volume-f7c30d32-1658-4864-b91e-3a86cc4f167a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc32c3-9fad-4c7e-a70f-27b4bc8729a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bc32c3-9fad-4c7e-a70f-27b4bc8729a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e594-bccf-4e15-8d2e-8644dccf423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Volume f7c30d32-1658-4864-b91e-3a86cc4f167a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c30d32-1658-4864-b91e-3a86cc4f167a', 'volume_size': 1} Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info" returned: 0 in 0.546s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info is being set with open permissions: ugo+rw Feb 27 02:08:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info Feb 27 02:08:26 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.info" returned: 0 in 0.507s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.775s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1562265941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c30d32-1658-4864-b91e-3a86cc4f167a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3ea74116d24f5d9e49633e05a01721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:26Z,use_quota=True,user_id='5c67258d47fa4a45a1cd6ea286b4c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Creating volume f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:27 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a 1073741824 Feb 27 02:08:27 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-e5272251-a094-4cb0-9253-00d4a2088f04 req-e552fb31-c910-4913-ac6b-e2f8f8bb20fc tempest-VolumesSnapshotsTestJSON-823851361 None] Create snapshot completed successfully Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "cinder-11a12591-e295-4786-ba1f-aa529ea7ddf5-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-11a12591-e295-4786-ba1f-aa529ea7ddf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "cinder-quobyte-11a12591-e295-4786-ba1f-aa529ea7ddf5" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-11a12591-e295-4786-ba1f-aa529ea7ddf5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Deleting offline snapshot 11a12591-e295-4786-ba1f-aa529ea7ddf5 of volume eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] snapshot_file for this snap is: volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde0f4b-bc0f-4dd8-9bfd-6cfede6eca79]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a 1073741824" returned: 0 in 0.727s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:28 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 Feb 27 02:08:28 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (ca2527bc-7bb0-43b2-b2e2-0b55db43b58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b778c7-b70f-472a-b95d-89b852e2d825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b778c7-b70f-472a-b95d-89b852e2d825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1970398136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614dfc9-2882-4315-b923-a9a38e3f454f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:28Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ba5bb5-68ad-49bd-a067-3212224f2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ba5bb5-68ad-49bd-a067-3212224f2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5bc757-4bbc-470a-8c85-306af193922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5bc757-4bbc-470a-8c85-306af193922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9614dfc9-2882-4315-b923-a9a38e3f454f', 'volume_name': 'volume-9614dfc9-2882-4315-b923-a9a38e3f454f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5e50d6-1926-4d15-b6cd-16faf0b2a020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5e50d6-1926-4d15-b6cd-16faf0b2a020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9337677-09c1-42bc-95e0-a7ecf787b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Volume 9614dfc9-2882-4315-b923-a9a38e3f454f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9614dfc9-2882-4315-b923-a9a38e3f454f', 'volume_size': 1} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5" returned: 0 in 0.664s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0a50b7-aba4-46d3-b872-05c1730dec02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8bee3-22c2-4ff7-9e9d-8fcea29933d0]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.682s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.221s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1970398136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614dfc9-2882-4315-b923-a9a38e3f454f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:28Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Creating volume 9614dfc9-2882-4315-b923-a9a38e3f454f {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:28 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e594-bccf-4e15-8d2e-8644dccf423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c30d32-1658-4864-b91e-3a86cc4f167a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 Feb 27 02:08:28 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f 1073741824 Feb 27 02:08:28 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038f9888-5a42-4f92-a82c-34d56ee143bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:28 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Volume volume-f7c30d32-1658-4864-b91e-3a86cc4f167a (f7c30d32-1658-4864-b91e-3a86cc4f167a): created successfully Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038f9888-5a42-4f92-a82c-34d56ee143bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (8bec76f0-556d-4d51-89c4-1b736cf7d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-bfcf3bee-6107-426b-90b8-8b94bc695f7a tempest-VolumesDeleteCascade-2131914936 None] Created volume successfully. Feb 27 02:08:29 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02" returned: 0 in 0.707s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 Feb 27 02:08:29 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f 1073741824" returned: 0 in 0.667s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f Feb 27 02:08:29 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:29 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5" returned: 0 in 0.562s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5 Feb 27 02:08:29 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f" returned: 0 in 0.594s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.215s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9337677-09c1-42bc-95e0-a7ecf787b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9614dfc9-2882-4315-b923-a9a38e3f454f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f6efb2-d778-45fa-96f2-d7f87bde537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Creating offline snapshot 364213d4-d3b3-456f-8a64-c33f5639f9a8 of volume f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Volume volume-9614dfc9-2882-4315-b923-a9a38e3f454f (9614dfc9-2882-4315-b923-a9a38e3f454f): created successfully Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f6efb2-d778-45fa-96f2-d7f87bde537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (ca2527bc-7bb0-43b2-b2e2-0b55db43b58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea33ea9-503f-461e-9dcd-9ba05539dec3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5f6cb318-1dbd-4291-a9e9-c4d000765e03 tempest-VolumesListTestJSON-1449218053 None] Created volume successfully. Feb 27 02:08:30 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:30 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02.11a12591-e295-4786-ba1f-aa529ea7ddf5" returned: 0 in 0.576s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-11a12591-e295-4786-ba1f-aa529ea7ddf5" released by "_delete_snapshot" :: held 2.601s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" released by "delete_snapshot" :: held 2.616s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.quota [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Created reservations ['4a886eed-6a7d-4a88-9748-0c42af090899', 'cb20a62b-0f1b-4543-87c0-4c1a6a597e3e', 'cf1ead51-ebf7-4548-a89d-6d1eb0262d34', 'd662cc38-4340-49e9-bb43-e0ef9efd2bf9'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Delete snapshot completed successfully. Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-745a14dd-e287-4e53-b88a-e4d4dba02e6c req-99bde429-084e-4372-9db5-aa1d62e57375 tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-11a12591-e295-4786-ba1f-aa529ea7ddf5-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:30 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.633s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 1G Feb 27 02:08:30 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (4ddc1948-d7fd-4470-95b2-021a93c13fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a70434a-cbd3-426e-b846-0ff7fa075647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a70434a-cbd3-426e-b846-0ff7fa075647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441004243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:31Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10ef1fd-4e17-4d5a-9560-7576fec92185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10ef1fd-4e17-4d5a-9560-7576fec92185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8171e822-6404-42da-b6c3-d22bb266a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8171e822-6404-42da-b6c3-d22bb266a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5', 'volume_name': 'volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d4bbd-3933-4453-841a-591f1f5679be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d4bbd-3933-4453-841a-591f1f5679be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf2b925-1e77-4962-98d5-ca4c1a5c70b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Volume 173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5', 'volume_size': 1} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "cinder-eb0a50b7-aba4-46d3-b872-05c1730dec02-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-eb0a50b7-aba4-46d3-b872-05c1730dec02-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f270eef-04a1-4b3e-8eb4-34442e449395]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 1G" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c30d32-1658-4864-b91e-3a86cc4f167a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c30d32-1658-4864-b91e-3a86cc4f167a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:31 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 Feb 27 02:08:31 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c30d32-1658-4864-b91e-3a86cc4f167a -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 is being set with open permissions: ugo+rw Feb 27 02:08:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:31 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02" returned: 0 in 0.695s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02 Feb 27 02:08:32 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.508s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info Feb 27 02:08:32 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-eb0a50b7-aba4-46d3-b872-05c1730dec02" returned: 0 in 0.506s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-quobyte-eb0a50b7-aba4-46d3-b872-05c1730dec02" released by "delete_volume" :: held 1.250s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG cinder.quota [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Created reservations ['0777d650-5f15-4068-810f-dcfa512bdd01', 'ebeda84f-5a61-48c6-a7ac-9db684ed6e82', 'fd87467c-6cb1-4f11-a175-b3cfdc0ca712', '03196a99-b29c-4661-b832-591294b9bb58'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:32 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info" returned: 0 in 0.551s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info is being set with open permissions: ugo+rw Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info Feb 27 02:08:33 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.manager [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Deleted volume successfully. Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [req-267c26c3-0674-44e8-ba3d-6ca34ab1f875 req-9edf471a-42c3-4732-b485-78fc1f91b93e tempest-VolumesSnapshotsTestJSON-823851361 None] Lock "cinder-eb0a50b7-aba4-46d3-b872-05c1730dec02-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:33 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.info" returned: 0 in 0.697s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.671s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441004243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:31Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Creating volume 173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:33 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 1073741824 Feb 27 02:08:33 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-430b1375-b4e6-45f6-80b3-da7b1dc7489d tempest-VolumesDeleteCascade-2131914936 None] Create snapshot completed successfully Feb 27 02:08:34 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 1073741824" returned: 0 in 0.639s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:34 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 Feb 27 02:08:34 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (7c2b4cd5-9050-4279-acc6-247b2319e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267f5c92-1eef-4a6f-887d-0a8eab13dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267f5c92-1eef-4a6f-887d-0a8eab13dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1609723913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241ef945-11c4-4a52-9077-2508439107e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3ea74116d24f5d9e49633e05a01721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=364213d4-d3b3-456f-8a64-c33f5639f9a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:34Z,use_quota=True,user_id='5c67258d47fa4a45a1cd6ea286b4c54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22895946-7fb0-4794-ac9c-197f08d4db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22895946-7fb0-4794-ac9c-197f08d4db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e0ceb4-0f84-4901-89be-8a9a5a495678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e0ceb4-0f84-4901-89be-8a9a5a495678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '241ef945-11c4-4a52-9077-2508439107e6', 'volume_name': 'volume-241ef945-11c4-4a52-9077-2508439107e6', 'volume_size': 1, 'snapshot_id': '364213d4-d3b3-456f-8a64-c33f5639f9a8'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bd8816-e2e5-4a28-9b27-d608c47db628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bd8816-e2e5-4a28-9b27-d608c47db628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b58a79-719a-434a-bed6-443469eb35b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:34 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Volume 241ef945-11c4-4a52-9077-2508439107e6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-241ef945-11c4-4a52-9077-2508439107e6', 'volume_size': 1, 'snapshot_id': '364213d4-d3b3-456f-8a64-c33f5639f9a8'} Feb 27 02:08:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" returned: 0 in 0.672s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.502s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8-241ef945-11c4-4a52-9077-2508439107e6" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf2b925-1e77-4962-98d5-ca4c1a5c70b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172fae1f-5c64-4f7f-8739-aaf91bcec9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8-241ef945-11c4-4a52-9077-2508439107e6" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Creating volume 241ef945-11c4-4a52-9077-2508439107e6 from snapshot 364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:35 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Volume volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 (173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5): created successfully Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172fae1f-5c64-4f7f-8739-aaf91bcec9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (4ddc1948-d7fd-4470-95b2-021a93c13fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] snapshot: 364213d4-d3b3-456f-8a64-c33f5639f9a8, volume: 241ef945-11c4-4a52-9077-2508439107e6, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0cb5dea9-0ed4-47d9-a42b-8c9c01c96ffa tempest-VolumesListTestJSON-1449218053 None] Created volume successfully. Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0100ecaa-cd2c-4dcd-bdcf-a230b4103f12]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:35 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (7b1df5d0-d618-4d69-85d4-dfc2ee858876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fcb2e1-e744-4463-ba23-e65427486997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fcb2e1-e744-4463-ba23-e65427486997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2141477639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdfd455-a85f-44ff-b026-3383d4ad5ed5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:36Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1b5c8c-c773-4eed-8d99-143abd5adf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1b5c8c-c773-4eed-8d99-143abd5adf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3415a4-1c6f-4137-aa3e-d21abb1d14a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3415a4-1c6f-4137-aa3e-d21abb1d14a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdfd455-a85f-44ff-b026-3383d4ad5ed5', 'volume_name': 'volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe89eb12-3b97-476e-b3a9-c9481eebef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe89eb12-3b97-476e-b3a9-c9481eebef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c198ed1f-a6ad-4133-9b6b-867b5e3de7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:35 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Volume 6bdfd455-a85f-44ff-b026-3383d4ad5ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5', 'volume_size': 1} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:35 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.699s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c30d32-1658-4864-b91e-3a86cc4f167a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c3546-7a8f-4d32-92c9-2cd322a91a52]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:36 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.585s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 Feb 27 02:08:36 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (30860ed6-bb6d-4d9e-90c5-f76cafb6f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9943e7-74b9-4f9c-95c0-d17f012b9041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9943e7-74b9-4f9c-95c0-d17f012b9041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272820689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28810cfa-0090-4fda-9f2a-3563ac9a72b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:37Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac41d7d-cb9a-41b2-b5db-c01ec0dae247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac41d7d-cb9a-41b2-b5db-c01ec0dae247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377b6cc1-efef-478c-8c55-ccd6ca5c20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377b6cc1-efef-478c-8c55-ccd6ca5c20a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28810cfa-0090-4fda-9f2a-3563ac9a72b2', 'volume_name': 'volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3376301c-02d3-4749-9c8b-5ba8ab38af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3376301c-02d3-4749-9c8b-5ba8ab38af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b5c6c1-3178-4653-8853-e7ad7dc89b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:36 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Volume 28810cfa-0090-4fda-9f2a-3563ac9a72b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2', 'volume_size': 1} Feb 27 02:08:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:38 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6" returned: 0 in 2.330s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:38 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3efd69-ad58-4af8-8959-fad51319ac22]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:38 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:38 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.666s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:39 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Converted 1024.00 MB image at 439.37 MB/s Feb 27 02:08:39 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 is being set with open permissions: ugo+rw Feb 27 02:08:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:39 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 Feb 27 02:08:39 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6" returned: 0 in 0.526s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" released by "_copy_volume_from_snapshot" :: held 4.887s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8-241ef945-11c4-4a52-9077-2508439107e6" released by "_create_volume_from_snapshot" :: held 4.926s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.961s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.226s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2141477639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdfd455-a85f-44ff-b026-3383d4ad5ed5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd2c9af2f29342cc8652b5cb2512c3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:36Z,use_quota=True,user_id='4fc5440824784f498c8ad06842c26758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Creating volume 6bdfd455-a85f-44ff-b026-3383d4ad5ed5 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:40 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 1073741824 Feb 27 02:08:40 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b58a79-719a-434a-bed6-443469eb35b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241ef945-11c4-4a52-9077-2508439107e6', 'volume_size': 1, 'snapshot_id': '364213d4-d3b3-456f-8a64-c33f5639f9a8'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accfc8bf-f679-45ca-aa8e-9c370dea4b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:40 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Volume volume-241ef945-11c4-4a52-9077-2508439107e6 (241ef945-11c4-4a52-9077-2508439107e6): created successfully Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accfc8bf-f679-45ca-aa8e-9c370dea4b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Flow 'volume_create_manager' (7c2b4cd5-9050-4279-acc6-247b2319e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:40 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b6e7c82b-113c-4a6f-85d0-0aca7d917673 tempest-VolumesDeleteCascade-2131914936 None] Created volume successfully. Feb 27 02:08:40 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 1073741824" returned: 0 in 0.622s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 Feb 27 02:08:40 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-f7c30d32-1658-4864-b91e-3a86cc4f167a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-f7c30d32-1658-4864-b91e-3a86cc4f167a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Performing cascade delete. {{(pid=83211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-364213d4-d3b3-456f-8a64-c33f5639f9a8-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-364213d4-d3b3-456f-8a64-c33f5639f9a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Deleting offline snapshot 364213d4-d3b3-456f-8a64-c33f5639f9a8 of volume f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] snapshot_file for this snap is: volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ffa221-3eb0-436c-aca6-f092ff51a352]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.550s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272820689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28810cfa-0090-4fda-9f2a-3563ac9a72b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:37Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Creating volume 28810cfa-0090-4fda-9f2a-3563ac9a72b2 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:41 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c198ed1f-a6ad-4133-9b6b-867b5e3de7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:41 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:41 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c20e8b3-3799-4337-bfa5-b36b2a9a46a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:41 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 1073741824 Feb 27 02:08:41 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Volume volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 (6bdfd455-a85f-44ff-b026-3383d4ad5ed5): created successfully Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c20e8b3-3799-4337-bfa5-b36b2a9a46a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Flow 'volume_create_manager' (7b1df5d0-d618-4d69-85d4-dfc2ee858876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:41 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9e8f37bc-9b15-45be-bbf4-5f0f296ecd6a tempest-VolumesListTestJSON-1449218053 None] Created volume successfully. Feb 27 02:08:41 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.579s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c30d32-1658-4864-b91e-3a86cc4f167a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[91170229-0684-4413-aefb-fbc667329177]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 1073741824" returned: 0 in 0.611s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:41 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 Feb 27 02:08:41 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b5c6c1-3178-4653-8853-e7ad7dc89b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2589fe02-3be2-4c12-b736-f30d2d54cab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:42 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Volume volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 (28810cfa-0090-4fda-9f2a-3563ac9a72b2): created successfully Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2589fe02-3be2-4c12-b736-f30d2d54cab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (30860ed6-bb6d-4d9e-90c5-f76cafb6f15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:42 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.717s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-61b10e6c-7841-4cc3-8241-d1c007e248a8 tempest-VolumesTestJSON-315840182 None] Created volume successfully. Feb 27 02:08:42 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:42 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.631s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8 Feb 27 02:08:43 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (c4153092-d570-4517-9874-c94a9cd73b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3784df0-5c37-4807-834d-2a319a28ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3784df0-5c37-4807-834d-2a319a28ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027963669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c50451e-1b30-4ec0-be61-a7b89ed0b6a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:43Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a24e94-28e8-4ee8-b197-3e27a9f51eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a24e94-28e8-4ee8-b197-3e27a9f51eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8805881-3f67-49ab-a197-42a7eb46015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8805881-3f67-49ab-a197-42a7eb46015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c50451e-1b30-4ec0-be61-a7b89ed0b6a8', 'volume_name': 'volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6ed0fd-cfe7-42c2-bb40-6b82c09c7dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6ed0fd-cfe7-42c2-bb40-6b82c09c7dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0db6f7-925d-4ef3-8811-050af527204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:43 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Volume 8c50451e-1b30-4ec0-be61-a7b89ed0b6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8', 'volume_size': 1} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1027963669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c50451e-1b30-4ec0-be61-a7b89ed0b6a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:43Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Creating volume 8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:43 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 1073741824 Feb 27 02:08:43 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a.364213d4-d3b3-456f-8a64-c33f5639f9a8" returned: 0 in 0.661s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-364213d4-d3b3-456f-8a64-c33f5639f9a8" released by "_delete_snapshot" :: held 2.652s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" released by "delete_snapshot" :: held 2.666s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['e0c81053-cfc1-428c-b31c-4ade1c9e0815', 'bd46e0be-603d-4dda-9216-61a784ef30b4', '45cd10bd-d656-4427-b11d-8097636d9d6b', '6063e292-3ae0-4eb2-9991-08e74b81b363'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Delete snapshot completed successfully. Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-364213d4-d3b3-456f-8a64-c33f5639f9a8-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Snapshots deleted, issuing volume delete {{(pid=83211) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34a8b0-3afd-495f-aa17-40be250a1312]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:44 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 1073741824" returned: 0 in 0.678s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 Feb 27 02:08:44 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-6bdfd455-a85f-44ff-b026-3383d4ad5ed5-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-6bdfd455-a85f-44ff-b026-3383d4ad5ed5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-quobyte-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c944e-fdb1-47e3-928d-648ab9a9fa2a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.698s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a Feb 27 02:08:44 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 Feb 27 02:08:44 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" returned: 0 in 0.569s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0db6f7-925d-4ef3-8811-050af527204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576fa137-9456-47ac-bfed-f8a37681614f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:44 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Volume volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 (8c50451e-1b30-4ec0-be61-a7b89ed0b6a8): created successfully Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576fa137-9456-47ac-bfed-f8a37681614f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (c4153092-d570-4517-9874-c94a9cd73b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:44 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c39c87c2-e482-4a57-ae15-fa27f648b2c9 tempest-VolumesTestJSON-315840182 None] Created volume successfully. Feb 27 02:08:45 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f7c30d32-1658-4864-b91e-3a86cc4f167a" returned: 0 in 0.492s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" returned: 0 in 0.613s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-f7c30d32-1658-4864-b91e-3a86cc4f167a" released by "delete_volume" :: held 1.232s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:45 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5 Feb 27 02:08:45 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['f8edfa7d-3580-459c-90e3-1b3b5c002e78', '54b90495-d98f-4855-91b8-678c52628bce', 'd77639c4-9956-42bf-b75a-655af414c5d8', '65dbc92f-6490-4942-b9e1-49917b0a2342'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:45 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-241ef945-11c4-4a52-9077-2508439107e6-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-241ef945-11c4-4a52-9077-2508439107e6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-6bdfd455-a85f-44ff-b026-3383d4ad5ed5" released by "delete_volume" :: held 1.168s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c479f984-7c0a-4fa7-863d-8556ce761cde]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Created reservations ['e09d4e68-aed8-43ea-92f9-66104201f0e1', '05c97830-19df-4bd2-9fef-a7ffc6aec606', '03af94dc-bd13-4986-bb50-e16a1b17c3e2', 'f28ef17c-12fd-4854-ac12-b770e268f2a9'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:45 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:45 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Deleted volume successfully. Feb 27 02:08:45 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 Feb 27 02:08:45 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-561448b6-8996-4c2d-9568-07aedc0bda82 tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-f7c30d32-1658-4864-b91e-3a86cc4f167a-delete_volume" released by "delete_volume" :: held 4.732s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:45 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (bda0b1e7-3074-47c3-ba1b-caa2aa20145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7ab35a-2dab-45e9-bcdf-b31d905d86ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7ab35a-2dab-45e9-bcdf-b31d905d86ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2102373247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60a4b8b-84c3-4979-a163-1616a592e567,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefa6258-affd-4540-94f4-09858764b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefa6258-affd-4540-94f4-09858764b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a1a799-2bd8-439c-82d0-0b210089c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a1a799-2bd8-439c-82d0-0b210089c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60a4b8b-84c3-4979-a163-1616a592e567', 'volume_name': 'volume-f60a4b8b-84c3-4979-a163-1616a592e567', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74824c98-8180-4d4a-abba-a38c4672a65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74824c98-8180-4d4a-abba-a38c4672a65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982fb8a-4fcf-4208-bd04-56cf9618a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Volume f60a4b8b-84c3-4979-a163-1616a592e567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60a4b8b-84c3-4979-a163-1616a592e567', 'volume_size': 1} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2102373247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60a4b8b-84c3-4979-a163-1616a592e567,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3067cb7c9174ebd92ff34a8baa7952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='598f39421258462986c72bac989f89b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Creating volume f60a4b8b-84c3-4979-a163-1616a592e567 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:46 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 1073741824 Feb 27 02:08:46 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6" returned: 0 in 0.561s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6 Feb 27 02:08:46 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.657s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Deleted volume successfully. Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9ec7934e-a068-4b12-9b3d-9d751c677ba7 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-6bdfd455-a85f-44ff-b026-3383d4ad5ed5-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-quobyte-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 1073741824" returned: 0 in 0.857s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b8bb3b-8fd6-42ea-adac-fd8b916cd9d9]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 Feb 27 02:08:47 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 Feb 27 02:08:47 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-241ef945-11c4-4a52-9077-2508439107e6" returned: 0 in 0.890s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-quobyte-241ef945-11c4-4a52-9077-2508439107e6" released by "delete_volume" :: held 1.495s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Created reservations ['c63def0d-f53a-400d-8f63-7f2b4e0bdc53', 'c3aedcc1-fdb9-4670-9772-60e4547ecaf5', 'fa6c4a88-0459-4f3a-b4e0-01725bf75d04', '6133a9cf-a761-45b1-a9c1-5d6848ea57d8'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:47 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" returned: 0 in 0.689s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567" returned: 0 in 0.619s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:47 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5 Feb 27 02:08:47 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982fb8a-4fcf-4208-bd04-56cf9618a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60a4b8b-84c3-4979-a163-1616a592e567', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5089d506-9d1c-4c3b-9c8f-6f284cf66148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Volume volume-f60a4b8b-84c3-4979-a163-1616a592e567 (f60a4b8b-84c3-4979-a163-1616a592e567): created successfully Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5089d506-9d1c-4c3b-9c8f-6f284cf66148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Flow 'volume_create_manager' (bda0b1e7-3074-47c3-ba1b-caa2aa20145d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4b983fbd-3c3f-4307-9a58-e11423ad0c7a tempest-VolumesTestJSON-315840182 None] Created volume successfully. Feb 27 02:08:47 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.599s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Deleted volume successfully. Feb 27 02:08:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-25dd1696-4886-453c-8d8d-45250299b65b tempest-VolumesDeleteCascade-2131914936 None] Lock "cinder-241ef945-11c4-4a52-9077-2508439107e6-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:48 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" returned: 0 in 0.561s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5" released by "delete_volume" :: held 1.305s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Created reservations ['839318dc-1f78-4985-bb74-f5ec5ace0397', '1debfebf-c993-437d-9999-f28e668f2e6d', '00fca5b8-7e87-4f33-8b38-8653717027dd', '5f1f852b-1e48-4849-9731-4247d8dccbee'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:48 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.781s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-f60a4b8b-84c3-4979-a163-1616a592e567-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:49 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Deleted volume successfully. Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "cinder-f60a4b8b-84c3-4979-a163-1616a592e567-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-abb61e87-25d7-4106-b860-cdab4b558ed9 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-173bf72c-ef79-4ca3-b3a5-1d5a354d3bd5-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-9614dfc9-2882-4315-b923-a9a38e3f454f-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (f56fdd50-ed81-4845-9fd9-673c2d32d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ec43f7-2570-4069-92d3-2e0e7eddd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ec43f7-2570-4069-92d3-2e0e7eddd208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1717740395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13907442-d170-46e6-aaf6-41c2f76fa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:49Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489e81d5-b297-478b-aca4-126983cbd6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489e81d5-b297-478b-aca4-126983cbd6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f311b1-12df-4b5f-97d3-91acf386221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f311b1-12df-4b5f-97d3-91acf386221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13907442-d170-46e6-aaf6-41c2f76fa73f', 'volume_name': 'volume-13907442-d170-46e6-aaf6-41c2f76fa73f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1987e741-da11-4060-b914-be2f459e5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1987e741-da11-4060-b914-be2f459e5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20496de6-1e5c-4ccd-8ff2-204a8287af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:49 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Volume 13907442-d170-46e6-aaf6-41c2f76fa73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13907442-d170-46e6-aaf6-41c2f76fa73f', 'volume_size': 1} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1717740395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13907442-d170-46e6-aaf6-41c2f76fa73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:49Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Creating volume 13907442-d170-46e6-aaf6-41c2f76fa73f {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:49 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f 1073741824 Feb 27 02:08:49 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-9614dfc9-2882-4315-b923-a9a38e3f454f-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-quobyte-f60a4b8b-84c3-4979-a163-1616a592e567" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "cinder-quobyte-9614dfc9-2882-4315-b923-a9a38e3f454f" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-f60a4b8b-84c3-4979-a163-1616a592e567" acquired by "delete_volume" :: waited 0.024s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-9614dfc9-2882-4315-b923-a9a38e3f454f" acquired by "delete_volume" :: waited 0.026s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7539f1d9-187d-45c8-8bb2-d298976a5653]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feda3f3-80a8-458b-930a-37bd315773fa]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f Feb 27 02:08:49 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 Feb 27 02:08:49 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f" returned: 0 in 0.673s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f 1073741824" returned: 0 in 0.826s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f Feb 27 02:08:50 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567" returned: 0 in 0.792s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567 Feb 27 02:08:50 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f Feb 27 02:08:50 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Flow 'volume_create_manager' (ff2f7447-09f5-4add-97b7-9c06fa41664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85f56f6-b087-4b57-bc79-3ec5eed9a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9614dfc9-2882-4315-b923-a9a38e3f454f" returned: 0 in 0.807s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f60a4b8b-84c3-4979-a163-1616a592e567" returned: 0 in 0.704s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-f60a4b8b-84c3-4979-a163-1616a592e567" released by "delete_volume" :: held 1.543s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85f56f6-b087-4b57-bc79-3ec5eed9a866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390355811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d931bdfab4e7417ab3dd89da3ee30250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='39b36ccd4656498fb985aa46822ceaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63976cb6-8d56-4e7e-849b-9aec6cc68dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63976cb6-8d56-4e7e-849b-9aec6cc68dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2304eace-c093-450d-a1e9-fc83de6d9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2304eace-c093-450d-a1e9-fc83de6d9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'volume_name': 'volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ad4d-23cc-41c8-b2a5-a1706b33b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f09ad4d-23cc-41c8-b2a5-a1706b33b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff35d5d4-8cd1-4c0d-9811-aa871a6e30d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Volume 18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'volume_size': 1} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-quobyte-9614dfc9-2882-4315-b923-a9a38e3f454f" released by "delete_volume" :: held 1.572s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f" returned: 0 in 0.801s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390355811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d931bdfab4e7417ab3dd89da3ee30250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:51Z,use_quota=True,user_id='39b36ccd4656498fb985aa46822ceaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Creating volume 18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d 1073741824 Feb 27 02:08:51 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20496de6-1e5c-4ccd-8ff2-204a8287af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13907442-d170-46e6-aaf6-41c2f76fa73f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8585f0e-9546-4b06-99d0-9dda59df7838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Volume volume-13907442-d170-46e6-aaf6-41c2f76fa73f (13907442-d170-46e6-aaf6-41c2f76fa73f): created successfully Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8585f0e-9546-4b06-99d0-9dda59df7838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (f56fdd50-ed81-4845-9fd9-673c2d32d86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3c72440d-b62a-4136-9abe-8d9bec6dec3f tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Created reservations ['5df4ade3-194e-4fe8-ac62-2a8c011dc2de', '3d732428-f869-4f93-8f73-f24ebbdd769a', '6c57adf9-1a03-4c24-91bb-0dc391bf2fde', '0aeb302e-a825-4f9a-a138-7269f664ae01'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Created reservations ['fc1e7aa6-923b-43ef-a1ab-f9387fc9e276', '0102718d-8e34-41cd-ba8a-95f723f07b9c', '0205437d-40de-4355-a6c8-15d80c868fd5', '613fafc4-83ce-4abd-beba-60e288d24883'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:51 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-84817eb5-b790-4761-99ba-231e51d120a5 tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f" by "attach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:51 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:51 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-84817eb5-b790-4761-99ba-231e51d120a5 tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f" acquired by "attach_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "cinder-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-quobyte-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" acquired by "delete_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-84817eb5-b790-4761-99ba-231e51d120a5 tempest-VolumesActionsTest-108144080 None] Attaching volume 13907442-d170-46e6-aaf6-41c2f76fa73f to instance e9d7a6f3-7c30-4021-9587-9b38e6892047 at mountpoint /dev/vdb on host None. Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b45ec-fa36-449c-8836-10308b715515]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-84817eb5-b790-4761-99ba-231e51d120a5 tempest-VolumesActionsTest-108144080 None] Attach volume completed successfully. Feb 27 02:08:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-84817eb5-b790-4761-99ba-231e51d120a5 tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f" released by "attach_volume" :: held 0.355s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:51 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 Feb 27 02:08:51 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.878s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Deleted volume successfully. Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e1decdc0-99bc-4aef-bd56-179056d20928 tempest-VolumesTestJSON-315840182 None] Lock "cinder-f60a4b8b-84c3-4979-a163-1616a592e567-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d 1073741824" returned: 0 in 1.115s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.892s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Deleted volume successfully. Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8d7a4f46-f9ee-41a2-be1f-f39170ba0666 tempest-VolumesListTestJSON-1449218053 None] Lock "cinder-9614dfc9-2882-4315-b923-a9a38e3f454f-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:08:52 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Terminate volume connection completed successfully. Feb 27 02:08:52 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" returned: 0 in 1.212s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.655s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:52 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8 Feb 27 02:08:52 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff35d5d4-8cd1-4c0d-9811-aa871a6e30d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1bbbee-f08d-4e6e-b616-e8c308ac0c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Volume volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d (18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d): created successfully Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1bbbee-f08d-4e6e-b616-e8c308ac0c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Flow 'volume_create_manager' (ff2f7447-09f5-4add-97b7-9c06fa41664f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ac09b0c3-83d4-44d8-a531-57ccae77cd17 tempest-VolumesCloneTest-1157358271 None] Created volume successfully. Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" by "detach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Detaching volume 13907442-d170-46e6-aaf6-41c2f76fa73f from instance e9d7a6f3-7c30-4021-9587-9b38e6892047. Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Detach volume completed successfully. Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-751afe9f-7c80-4ef7-9ddb-6c0c38869ef6 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:53 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Flow 'volume_create_manager' (f83774ec-6600-44e2-b5fc-5cabd7375ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf2935-91cf-421a-8bf5-ad1b588f2bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf2935-91cf-421a-8bf5-ad1b588f2bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1999677278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d931bdfab4e7417ab3dd89da3ee30250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:53Z,use_quota=True,user_id='39b36ccd4656498fb985aa46822ceaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15781fb-cfbd-4096-85c8-60f76a255226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15781fb-cfbd-4096-85c8-60f76a255226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0873ad-8d45-41a8-9005-276c9c16945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0873ad-8d45-41a8-9005-276c9c16945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93', 'volume_name': 'volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93', 'volume_size': 2, 'source_volid': '18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b797054c-dbef-452f-98d0-bca75ef17a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b797054c-dbef-452f-98d0-bca75ef17a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39145be8-ade1-43c7-a7e0-88c5388771d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Volume 6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93', 'volume_size': 2, 'source_volid': '18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'source_volstatus': 'available'} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Cloning volume 18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d to volume 6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" returned: 0 in 0.749s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8" released by "delete_volume" :: held 2.025s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Creating offline snapshot eef4687d-e22f-4e40-a770-7a6e05965961 of volume 18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[708cbd42-0bf5-4941-b5aa-880aad039cde]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Created reservations ['0574ec47-3255-4393-8262-d0547b86b13a', '8e599317-eb01-4f43-aaab-db1b5c60c1f7', '22297f65-b229-4669-8845-979aefe024ea', 'a4b21a82-097e-42ff-8031-afadbe5fb862'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edbc134c-6cd5-4dff-8e2e-9e1612b676c4 tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" by "detach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edbc134c-6cd5-4dff-8e2e-9e1612b676c4 tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-edbc134c-6cd5-4dff-8e2e-9e1612b676c4 tempest-VolumesActionsTest-108144080 None] Volume detach called, but volume not attached. Feb 27 02:08:53 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:08:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edbc134c-6cd5-4dff-8e2e-9e1612b676c4 tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:53 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:53 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:53 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Flow 'volume_create_manager' (6ef2b85f-089e-468e-8bca-a33490724c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216aa5da-94f7-4eaa-b9df-ce9f93bfae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216aa5da-94f7-4eaa-b9df-ce9f93bfae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1008574696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1f8b9f-2ab6-4354-8440-de5393858942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddca55e2ca9f4b43a82ccba2d2397bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:54Z,use_quota=True,user_id='51cfdfe603ff442d9e77214fc88222d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22fe107-486f-4115-ac7c-2acea718ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22fe107-486f-4115-ac7c-2acea718ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da2ccb-7045-40e2-a4fb-c00355e5a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da2ccb-7045-40e2-a4fb-c00355e5a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1f8b9f-2ab6-4354-8440-de5393858942', 'volume_name': 'volume-7d1f8b9f-2ab6-4354-8440-de5393858942', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9781b949-ac4e-4576-aa9b-0ca9524a7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9781b949-ac4e-4576-aa9b-0ca9524a7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcf4870-e801-43b8-a16c-af12954fba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:54 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Volume 7d1f8b9f-2ab6-4354-8440-de5393858942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1f8b9f-2ab6-4354-8440-de5393858942', 'volume_size': 1} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:54 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.532s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:54 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Deleted volume successfully. Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b8b56e0e-f903-412a-bffc-f59f44426c12 tempest-VolumesTestJSON-315840182 None] Lock "cinder-8c50451e-1b30-4ec0-be61-a7b89ed0b6a8-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:54 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.702s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 1G Feb 27 02:08:54 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-quobyte-13907442-d170-46e6-aaf6-41c2f76fa73f" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "cinder-quobyte-13907442-d170-46e6-aaf6-41c2f76fa73f" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d26158f-8e94-4e6d-88d2-1f2a79861ad1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f Feb 27 02:08:54 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-28810cfa-0090-4fda-9f2a-3563ac9a72b2-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "cinder-28810cfa-0090-4fda-9f2a-3563ac9a72b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Acquiring lock "cinder-quobyte-28810cfa-0090-4fda-9f2a-3563ac9a72b2" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-28810cfa-0090-4fda-9f2a-3563ac9a72b2" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8409b0-9175-48d8-9caa-1243c28d1058]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 Feb 27 02:08:55 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 1G" returned: 0 in 0.628s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:08:55 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f Feb 27 02:08:55 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2" returned: 0 in 0.553s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2 Feb 27 02:08:55 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.500s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 is being set with open permissions: ugo+rw Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:08:55 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-13907442-d170-46e6-aaf6-41c2f76fa73f" returned: 0 in 0.573s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "cinder-quobyte-13907442-d170-46e6-aaf6-41c2f76fa73f" released by "delete_volume" :: held 1.199s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=191,cinder:INSERT=58,cinder:UPDATE=241,cinder:DELETE=21 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=218,cinder:SELECT=168,cinder:INSERT=66,cinder:DELETE=19 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Created reservations ['50c85e28-d5b1-4866-924b-474fd5d3d499', 'f8c16742-de86-463f-b51c-768b50b69b33', 'c4473a87-4fad-4207-9e89-fc2c0e6a77a7', '852c9e24-3bf3-42cf-b599-a98f9c2b004c'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:55 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-28810cfa-0090-4fda-9f2a-3563ac9a72b2" returned: 0 in 0.543s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "cinder-quobyte-28810cfa-0090-4fda-9f2a-3563ac9a72b2" released by "delete_volume" :: held 1.122s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Created reservations ['43e108be-88f5-4f63-a2e5-d6c60a746929', '1bdf88c2-ec54-4901-8249-22afe53c313c', '50789273-0df8-4cd0-88cd-f06aad363fc4', 'a00eaf38-23da-47e2-b8ef-289e9e1829c9'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:56 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.549s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:08:56 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info Feb 27 02:08:56 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.466s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Deleted volume successfully. Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-237b10c5-a2a3-4c64-8bc2-18e7be6ed38e tempest-VolumesActionsTest-108144080 None] Lock "cinder-13907442-d170-46e6-aaf6-41c2f76fa73f-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:56 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.440s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Deleted volume successfully. Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0d788cc9-e12a-4302-bcda-7457d99bf8f1 tempest-VolumesTestJSON-315840182 None] Lock "cinder-28810cfa-0090-4fda-9f2a-3563ac9a72b2-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:56 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info" returned: 0 in 0.498s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info is being set with open permissions: ugo+rw Feb 27 02:08:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info Feb 27 02:08:56 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.info" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] snapshot: eef4687d-e22f-4e40-a770-7a6e05965961, volume: 6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96e487-93fb-4c75-9ca2-9b152c20bc88]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:08:57 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.615s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9505b86-f6f3-4587-9045-f54193e53eb0]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:08:57 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.646s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 Feb 27 02:08:58 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" returned: 0 in 2.700s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac45520-99b6-4f99-b918-fef6d707afcd]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:09:01 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:02 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.781s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:02 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Converted 1024.00 MB image at 378.87 MB/s Feb 27 02:09:02 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 is being set with open permissions: ugo+rw Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 Feb 27 02:09:02 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:02 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" returned: 0 in 0.615s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" released by "_copy_volume_from_snapshot" :: held 5.422s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-quobyte-eef4687d-e22f-4e40-a770-7a6e05965961" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-eef4687d-e22f-4e40-a770-7a6e05965961" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Deleting offline snapshot eef4687d-e22f-4e40-a770-7a6e05965961 of volume 18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] snapshot_file for this snap is: volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f0d45-689e-4fb7-aac7-2b60becfcd52]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:09:02 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.623s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20bb06-51bb-4f6d-97ea-5cb44c04028f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:09:03 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.605s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:09:03 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7e881168-e54c-4102-b1a5-2288df22ad7a tempest-BackendsCapabilitiesAdminTestsJSON-1804830726 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7397422790527, 'free_capacity_gb': 1775.7397422790527, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83211) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:09:04 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.523s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961 Feb 27 02:09:04 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-93064a59-0b7d-46b1-a49b-cf35a9d38c3b tempest-BackendsCapabilitiesAdminTestsJSON-1804830726 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7397422790527, 'free_capacity_gb': 1775.7397422790527, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83211) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:09:04 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d.eef4687d-e22f-4e40-a770-7a6e05965961" returned: 0 in 0.499s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-eef4687d-e22f-4e40-a770-7a6e05965961" released by "_delete_snapshot" :: held 2.324s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.360s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.656s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1008574696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1f8b9f-2ab6-4354-8440-de5393858942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddca55e2ca9f4b43a82ccba2d2397bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:54Z,use_quota=True,user_id='51cfdfe603ff442d9e77214fc88222d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Creating volume 7d1f8b9f-2ab6-4354-8440-de5393858942 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:05 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 1073741824 Feb 27 02:09:05 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39145be8-ade1-43c7-a7e0-88c5388771d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93', 'volume_size': 2, 'source_volid': '18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be56dd73-be5f-4cab-a210-9a3b0e288498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (a21d0f44-36a7-4dd0-a7b9-aa657d86ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a4d08b-a433-47ac-82d6-9f5c9a1c1193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Volume volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 (6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93): created successfully Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be56dd73-be5f-4cab-a210-9a3b0e288498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Flow 'volume_create_manager' (f83774ec-6600-44e2-b5fc-5cabd7375ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a4d08b-a433-47ac-82d6-9f5c9a1c1193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580592490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967c4cc8-6e21-424f-862d-2daacd4a6307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158ee133-b4be-4813-b2e2-97d81c13d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158ee133-b4be-4813-b2e2-97d81c13d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4b4a9f-104c-4468-8947-4b31a67e4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4b4a9f-104c-4468-8947-4b31a67e4b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967c4cc8-6e21-424f-862d-2daacd4a6307', 'volume_name': 'volume-967c4cc8-6e21-424f-862d-2daacd4a6307', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7d1a3f-7f1a-4dc5-b6ca-667c72b3fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7d1a3f-7f1a-4dc5-b6ca-667c72b3fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600b8fde-0584-437a-94ce-f5f35bd8e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:05 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Volume 967c4cc8-6e21-424f-862d-2daacd4a6307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967c4cc8-6e21-424f-862d-2daacd4a6307', 'volume_size': 1} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d4910bbf-754b-4ca6-98c6-581084c0cf1a tempest-VolumesCloneTest-1157358271 None] Created volume successfully. Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "cinder-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6774b196-1f24-4680-b16c-d16760cdf49e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 1073741824" returned: 0 in 0.691s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 Feb 27 02:09:05 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 Feb 27 02:09:05 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942" returned: 0 in 0.583s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1580592490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967c4cc8-6e21-424f-862d-2daacd4a6307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Creating volume 967c4cc8-6e21-424f-862d-2daacd4a6307 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:06 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcf4870-e801-43b8-a16c-af12954fba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1f8b9f-2ab6-4354-8440-de5393858942', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238d7289-1ce3-4d2d-b78c-fe00c3a53865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:06 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 1073741824 Feb 27 02:09:06 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" returned: 0 in 0.753s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Volume volume-7d1f8b9f-2ab6-4354-8440-de5393858942 (7d1f8b9f-2ab6-4354-8440-de5393858942): created successfully Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238d7289-1ce3-4d2d-b78c-fe00c3a53865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:06 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93 Feb 27 02:09:06 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Flow 'volume_create_manager' (6ef2b85f-089e-468e-8bca-a33490724c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:06 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ab94b6ca-a909-4900-886e-3815e9269b2f tempest-VolumesNegativeTest-2089688343 None] Created volume successfully. Feb 27 02:09:07 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" returned: 0 in 0.590s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93" released by "delete_volume" :: held 1.371s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:07 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Created reservations ['b10a095d-fdac-401e-a91d-7c948fcd608b', 'e2ceb94f-99b7-4ade-88e4-9761e7575f20', '7232139f-a3db-4a35-ab3b-401de33175e7', '129803b8-121b-42f3-b7c7-16d70955d318'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 1073741824" returned: 0 in 0.694s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 Feb 27 02:09:07 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:07 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307" returned: 0 in 0.650s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600b8fde-0584-437a-94ce-f5f35bd8e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967c4cc8-6e21-424f-862d-2daacd4a6307', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead652e-64dc-4b8d-9ecf-5dae301c2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Volume volume-967c4cc8-6e21-424f-862d-2daacd4a6307 (967c4cc8-6e21-424f-862d-2daacd4a6307): created successfully Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ead652e-64dc-4b8d-9ecf-5dae301c2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (a21d0f44-36a7-4dd0-a7b9-aa657d86ae67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-451b3186-1314-4d81-83b4-e1961869c1fc tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:09:07 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.749s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Deleted volume successfully. Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-34541cf5-6119-41bc-b7ab-c94552fc0c6e tempest-VolumesCloneTest-1157358271 None] Lock "cinder-6aaf5a1e-67b4-4f4c-8b20-4b802b9c7a93-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "cinder-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Acquiring lock "cinder-quobyte-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b6a31-2ebf-456b-85a9-8f1f43bc7e13]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:09:08 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-967c4cc8-6e21-424f-862d-2daacd4a6307-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-967c4cc8-6e21-424f-862d-2daacd4a6307-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-quobyte-967c4cc8-6e21-424f-862d-2daacd4a6307" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-967c4cc8-6e21-424f-862d-2daacd4a6307" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66d4701-7bf4-432c-a871-be254e617176]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 Feb 27 02:09:08 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.769s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d Feb 27 02:09:08 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307" returned: 0 in 0.619s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307 Feb 27 02:09:09 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" returned: 0 in 0.526s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "cinder-quobyte-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d" released by "delete_volume" :: held 1.363s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Created reservations ['1ff0021f-4251-4a02-b38e-8641e07956f4', 'ff14a2fb-4ed4-4053-b97b-b2218eeeef76', 'dda55502-baf2-4a91-bff2-a41af876277c', 'ecb1ef2e-dc3c-4f76-9bd0-370cf0d97967'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:09 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-967c4cc8-6e21-424f-862d-2daacd4a6307" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-967c4cc8-6e21-424f-862d-2daacd4a6307" released by "delete_volume" :: held 1.182s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Created reservations ['33896017-baf2-42ae-821d-7b46b72a6b91', '6982cf8b-2ca1-4d23-880e-7678b5828482', 'f3bf2676-c2b4-48d8-a036-b0429db0b284', 'b7a165ee-c144-4357-959e-70326b09db6b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:09 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.547s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Deleted volume successfully. Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8db936da-968b-4012-9a2e-cf5d18583dd4 tempest-VolumesCloneTest-1157358271 None] Lock "cinder-18ad1b36-45d2-4f9c-9a6e-79cebaff2a1d-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Deleted volume successfully. Feb 27 02:09:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1893127d-737a-408a-87dc-c84e7e8e3ac5 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-967c4cc8-6e21-424f-862d-2daacd4a6307-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (9894cd4e-4a13-4683-a749-9caeda3c4fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ec3301-563a-48fa-8a24-73039a39898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ec3301-563a-48fa-8a24-73039a39898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649835628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd00c49-4c35-4beb-9d52-d7c12b70e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:11Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6d4da-d67a-44af-ad33-19ba2ce22068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6d4da-d67a-44af-ad33-19ba2ce22068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f34b91-80d6-423d-9692-ae8508c3fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f34b91-80d6-423d-9692-ae8508c3fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd00c49-4c35-4beb-9d52-d7c12b70e612', 'volume_name': 'volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c04110-17f5-427f-8646-a979333f3b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c04110-17f5-427f-8646-a979333f3b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e5118-5b3c-4f6c-b14c-61b37bda41ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Volume 3bd00c49-4c35-4beb-9d52-d7c12b70e612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612', 'volume_size': 1} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649835628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd00c49-4c35-4beb-9d52-d7c12b70e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:11Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Creating volume 3bd00c49-4c35-4beb-9d52-d7c12b70e612 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:11 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 1073741824 Feb 27 02:09:11 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 1073741824" returned: 0 in 0.647s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 Feb 27 02:09:11 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e5118-5b3c-4f6c-b14c-61b37bda41ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92688d26-db19-4a27-9c1e-caaefaf3068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Volume volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 (3bd00c49-4c35-4beb-9d52-d7c12b70e612): created successfully Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92688d26-db19-4a27-9c1e-caaefaf3068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (9894cd4e-4a13-4683-a749-9caeda3c4fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-63f57a8d-8f20-4b9f-be1b-07365ec3a7fb tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Flow 'volume_create_manager' (78966415-18b7-480a-b4b1-03146f0bfbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c4ba3c-8f02-4126-acf6-abc0891e4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c4ba3c-8f02-4126-acf6-abc0891e4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-393525261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5826884d-e0f6-4c58-b5a1-d3bc9a429a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753a8b1d60784f12a284dad020764549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='17c6729430b5426c8f6525c9575955ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f933742a-4d07-4219-9aff-b701957a7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f933742a-4d07-4219-9aff-b701957a7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4386b83e-4e53-41ce-838f-8e00ceba45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4386b83e-4e53-41ce-838f-8e00ceba45ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5826884d-e0f6-4c58-b5a1-d3bc9a429a25', 'volume_name': 'volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25', 'volume_size': 2}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6e37ed-1a71-4cfb-b896-b0344bdd35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6e37ed-1a71-4cfb-b896-b0344bdd35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c5053d-37e6-4dc0-b52e-c02a225ca2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Volume 5826884d-e0f6-4c58-b5a1-d3bc9a429a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25', 'volume_size': 2} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-393525261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5826884d-e0f6-4c58-b5a1-d3bc9a429a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753a8b1d60784f12a284dad020764549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='17c6729430b5426c8f6525c9575955ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Creating volume 5826884d-e0f6-4c58-b5a1-d3bc9a429a25 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:12 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 2147483648 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 2147483648 Feb 27 02:09:12 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-3bd00c49-4c35-4beb-9d52-d7c12b70e612-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-3bd00c49-4c35-4beb-9d52-d7c12b70e612-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-quobyte-3bd00c49-4c35-4beb-9d52-d7c12b70e612" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-3bd00c49-4c35-4beb-9d52-d7c12b70e612" acquired by "delete_volume" :: waited 0.030s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c41b6c-c89e-4132-8159-591ba6679831]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:13 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 Feb 27 02:09:13 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 2147483648" returned: 0 in 0.845s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 Feb 27 02:09:13 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.700s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:14 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612" returned: 0 in 0.782s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612 Feb 27 02:09:14 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" returned: 0 in 0.660s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c5053d-37e6-4dc0-b52e-c02a225ca2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25', 'volume_size': 2}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe77d75-57d6-4bc7-b8c8-f470231e744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Volume volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 (5826884d-e0f6-4c58-b5a1-d3bc9a429a25): created successfully Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe77d75-57d6-4bc7-b8c8-f470231e744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Flow 'volume_create_manager' (78966415-18b7-480a-b4b1-03146f0bfbe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9f626912-6325-4ce2-9a25-c89ee7799bbe tempest-VolumesCloneNegativeTest-658138059 None] Created volume successfully. Feb 27 02:09:14 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3bd00c49-4c35-4beb-9d52-d7c12b70e612" returned: 0 in 0.549s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-3bd00c49-4c35-4beb-9d52-d7c12b70e612" released by "delete_volume" :: held 1.367s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Created reservations ['12165205-c219-404f-bdc8-4af90e487b26', '172882a0-bdae-4238-86bd-10b1c233e183', '141ccafc-af3c-4197-aedc-ba1b41ec4de6', '00b23ec2-c689-482e-a477-cf024b5c43dd'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:15 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Acquiring lock "cinder-5826884d-e0f6-4c58-b5a1-d3bc9a429a25-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "cinder-5826884d-e0f6-4c58-b5a1-d3bc9a429a25-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Acquiring lock "cinder-quobyte-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "cinder-quobyte-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e9eb67-e2fc-45e7-892e-43c966adbf08]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 Feb 27 02:09:15 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.582s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Deleted volume successfully. Feb 27 02:09:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-96d30c58-9ef8-4bd5-bba0-649486253e37 tempest-VolumesActionsTest-1111050044 None] Lock "cinder-3bd00c49-4c35-4beb-9d52-d7c12b70e612-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:16 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (5c7a7f9b-1ac3-41d3-b8f4-0f1d08671ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41c436-ffe5-45dc-b7e7-32c1f4c60983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" returned: 0 in 0.824s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25 Feb 27 02:09:16 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41c436-ffe5-45dc-b7e7-32c1f4c60983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903257479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b46f47-d010-45d1-b779-3226688dae47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:16Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4f66a-cb0e-4af2-93ef-9cff660ac292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f4f66a-cb0e-4af2-93ef-9cff660ac292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae4a9a-c229-42c3-bba4-f82f5fc739a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae4a9a-c229-42c3-bba4-f82f5fc739a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b46f47-d010-45d1-b779-3226688dae47', 'volume_name': 'volume-d3b46f47-d010-45d1-b779-3226688dae47', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c3a473-35c4-4270-acec-263ef872bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c3a473-35c4-4270-acec-263ef872bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b569b52-eaa6-4428-a546-66be9b49e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Volume d3b46f47-d010-45d1-b779-3226688dae47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b46f47-d010-45d1-b779-3226688dae47', 'volume_size': 1} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-903257479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b46f47-d010-45d1-b779-3226688dae47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:16Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Creating volume d3b46f47-d010-45d1-b779-3226688dae47 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:16 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 1073741824 Feb 27 02:09:16 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" returned: 0 in 0.478s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "cinder-quobyte-5826884d-e0f6-4c58-b5a1-d3bc9a429a25" released by "delete_volume" :: held 1.329s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Created reservations ['d5528f64-16cf-40a7-9ec4-f44fb397aa01', '5a3c4454-fb68-4a10-880c-1198519a64dd', '6ccb6344-e8aa-465f-a8c2-b25dbd180bdd', 'c426b12a-b796-414c-bd55-a1cd9483f8eb'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:16 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 1073741824" returned: 0 in 0.656s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 Feb 27 02:09:16 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.599s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Deleted volume successfully. Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-23710478-5732-4feb-a67b-a90d68df1c5c tempest-VolumesCloneNegativeTest-658138059 None] Lock "cinder-5826884d-e0f6-4c58-b5a1-d3bc9a429a25-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:17 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47" returned: 0 in 0.636s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b569b52-eaa6-4428-a546-66be9b49e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b46f47-d010-45d1-b779-3226688dae47', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed01b729-9090-4527-813e-ae397b44f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:17 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Volume volume-d3b46f47-d010-45d1-b779-3226688dae47 (d3b46f47-d010-45d1-b779-3226688dae47): created successfully Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed01b729-9090-4527-813e-ae397b44f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:17 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (5c7a7f9b-1ac3-41d3-b8f4-0f1d08671ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-010592e7-5381-4d94-a43f-6689b0d09525 tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-d3b46f47-d010-45d1-b779-3226688dae47-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "cinder-d3b46f47-d010-45d1-b779-3226688dae47-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-quobyte-d3b46f47-d010-45d1-b779-3226688dae47" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-d3b46f47-d010-45d1-b779-3226688dae47" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264dc6e-57c0-4db1-8606-74b3330782a9]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 Feb 27 02:09:18 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47" returned: 0 in 0.853s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47 Feb 27 02:09:19 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d3b46f47-d010-45d1-b779-3226688dae47" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-d3b46f47-d010-45d1-b779-3226688dae47" released by "delete_volume" :: held 1.427s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Created reservations ['6dcb3383-baa3-4b2b-8559-ea63a04b8c2c', '2dde2e03-2489-41d0-8009-aeec359d0004', 'ad4cfc3f-1a0f-4e7d-8f2c-ad0719e34a0c', '45463cdc-7fde-4817-8fcd-52c845e5351b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:20 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.677s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Deleted volume successfully. Feb 27 02:09:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-09a7ec07-191a-404e-a1b5-7983613540bb tempest-VolumesActionsTest-1111050044 None] Lock "cinder-d3b46f47-d010-45d1-b779-3226688dae47-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Flow 'volume_create_manager' (4ae6985c-e1ce-422b-879b-579886918300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b3f8ec-8d0a-490d-8660-609093882c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b3f8ec-8d0a-490d-8660-609093882c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-497734788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcae118-27e0-4395-ae64-7aefffd23f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea2a09e6dc84d5895f6a7b094de119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:21Z,use_quota=True,user_id='c500b7b0ed934769bb80d4d8e62c3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a39c7-3ce5-4924-973c-55d759afb95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a39c7-3ce5-4924-973c-55d759afb95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64721cac-b681-4d29-a275-48c56fc037b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.image.glance [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Creating Keystone auth plugin from conf {{(pid=83211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (66344dbb-9cb4-4121-bc31-3c389b324000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c658b7fe-c883-4921-87a6-1c8ad24372cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c658b7fe-c883-4921-87a6-1c8ad24372cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-580932067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec40e99-d274-4bb4-bfb6-8e851e1a6aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:21Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fad1b4-7da7-4748-88ed-99ffd15d4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fad1b4-7da7-4748-88ed-99ffd15d4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47058bb3-1e8d-4cb8-a795-e9eb4c8325b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47058bb3-1e8d-4cb8-a795-e9eb4c8325b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec40e99-d274-4bb4-bfb6-8e851e1a6aee', 'volume_name': 'volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3643945-b3b6-411a-ac04-1e4698f1ce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3643945-b3b6-411a-ac04-1e4698f1ce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fbf4f-a10c-4459-b2df-364723173b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Volume 0ec40e99-d274-4bb4-bfb6-8e851e1a6aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee', 'volume_size': 1} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-580932067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec40e99-d274-4bb4-bfb6-8e851e1a6aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:21Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Creating volume 0ec40e99-d274-4bb4-bfb6-8e851e1a6aee {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:21 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64721cac-b681-4d29-a275-48c56fc037b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1dcae118-27e0-4395-ae64-7aefffd23f50', 'volume_name': 'volume-1dcae118-27e0-4395-ae64-7aefffd23f50', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2c6b78-7c0d-4bdd-ba83-f6fc02afcb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2c6b78-7c0d-4bdd-ba83-f6fc02afcb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:21 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee 1073741824 Feb 27 02:09:21 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98432c4-ee38-4abc-9c06-6008a30ed54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:21 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Volume 1dcae118-27e0-4395-ae64-7aefffd23f50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1dcae118-27e0-4395-ae64-7aefffd23f50', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Trying to clone 1dcae118-27e0-4395-ae64-7aefffd23f50 from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]). {{(pid=83211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:09:21 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e81ac8a-98c7-445d-a80b-f8586fa77453]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD Feb 27 02:09:21 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee 1073741824" returned: 0 in 1.000s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee Feb 27 02:09:22 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 is fetched for user c500b7b0ed934769bb80d4d8e62c3af9. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c3edb-659d-43b5-9366-7060ef217fab]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD Feb 27 02:09:22 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" returned: 0 in 0.606s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5fbf4f-a10c-4459-b2df-364723173b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b681cc0-b6c1-4766-aae8-11467c3ae162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:23 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Volume volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee (0ec40e99-d274-4bb4-bfb6-8e851e1a6aee): created successfully Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b681cc0-b6c1-4766-aae8-11467c3ae162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (66344dbb-9cb4-4121-bc31-3c389b324000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:23 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-cd552343-2216-456a-b0d0-50216f364fb0 tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:09:23 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-497734788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcae118-27e0-4395-ae64-7aefffd23f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea2a09e6dc84d5895f6a7b094de119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:21Z,use_quota=True,user_id='c500b7b0ed934769bb80d4d8e62c3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Creating volume 1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:23 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1073741824 Feb 27 02:09:23 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "cinder-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Acquiring lock "cinder-quobyte-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc03c6e-b1db-4f12-a7a9-adb97f72461b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee Feb 27 02:09:23 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1073741824" returned: 0 in 0.830s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:24 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" returned: 0 in 0.714s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee Feb 27 02:09:24 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 0.587s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Attempting download of 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 1dcae118-27e0-4395-ae64-7aefffd23f50. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[852e4b4c-a9be-4be0-b889-0f882e5aa557]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1 Feb 27 02:09:25 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" returned: 0 in 0.615s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "cinder-quobyte-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee" released by "delete_volume" :: held 1.356s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Created reservations ['f3322922-4188-4e70-b54e-3138ee334646', 'c8fe773c-b5e2-42e6-91fa-7273ecc2b305', '529d1701-428e-469c-9cff-16740ddbc4f7', '50200d48-cc5d-43c2-8bf5-15ecec159e7f'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:25 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1 Feb 27 02:09:25 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.473s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Deleted volume successfully. Feb 27 02:09:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-62fda12a-2b70-4c1f-b567-369055089c2e tempest-VolumesActionsTest-1111050044 None] Lock "cinder-0ec40e99-d274-4bb4-bfb6-8e851e1a6aee-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1" returned: 1 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_5aoaasb1' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d49c14-40ca-4a7f-9be7-02b8a8bdfd95]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD Feb 27 02:09:26 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (7f9fd353-ec23-492b-ab3c-66026415f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8398b47-b6a8-4b69-b1ec-5f0bd6085f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8398b47-b6a8-4b69-b1ec-5f0bd6085f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169375529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea0fd4f-80d2-4215-8c47-b2a47a1480b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f57f30-86e7-4095-9914-6279c32e33fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f57f30-86e7-4095-9914-6279c32e33fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeeeb86-bb89-4c17-ab3c-8225db27e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeeeb86-bb89-4c17-ab3c-8225db27e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea0fd4f-80d2-4215-8c47-b2a47a1480b9', 'volume_name': 'volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be8d06-0805-484f-9303-bcfcfa20b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1be8d06-0805-484f-9303-bcfcfa20b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6d3298-8b12-4b35-b22a-3a7825a47a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Volume 4ea0fd4f-80d2-4215-8c47-b2a47a1480b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9', 'volume_size': 1} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169375529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea0fd4f-80d2-4215-8c47-b2a47a1480b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2516c1df3a874f9c8599812311b6228a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='50ccb6429ffb4f7999ed13f46c921e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Creating volume 4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:26 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 1073741824 Feb 27 02:09:26 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] 362137d4-09ea-4da7-92c5-9fdbd53eaec8 was qcow2, converting to raw {{(pid=83211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:26 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Flow 'volume_create_manager' (0d25fbee-ff11-49e4-9aa2-1af331988998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e05975c-3d16-4718-9a2c-2b910910fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e05975c-3d16-4718-9a2c-2b910910fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2133385905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55dea4e-5f59-4b50-901d-ab66bb6df1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49560fb2d55d4be0916c9589b86d5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='ada9f0cdfed44c69ad1d657e347eed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456dfe9-076b-4355-a31c-f6c003c420d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456dfe9-076b-4355-a31c-f6c003c420d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b031e0-4bbe-4cd1-a077-9cf795330fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b031e0-4bbe-4cd1-a077-9cf795330fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55dea4e-5f59-4b50-901d-ab66bb6df1b2', 'volume_name': 'volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a15f79-8d8f-4b16-b7b1-97ccbb22a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a15f79-8d8f-4b16-b7b1-97ccbb22a654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99530137-13c0-4501-bad8-b45f3863621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Volume f55dea4e-5f59-4b50-901d-ab66bb6df1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2', 'volume_size': 1} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 1073741824" returned: 0 in 0.591s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 Feb 27 02:09:27 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2133385905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55dea4e-5f59-4b50-901d-ab66bb6df1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49560fb2d55d4be0916c9589b86d5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='ada9f0cdfed44c69ad1d657e347eed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Creating volume f55dea4e-5f59-4b50-901d-ab66bb6df1b2 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:27 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6d3298-8b12-4b35-b22a-3a7825a47a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 1073741824 Feb 27 02:09:27 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8a6828-e9e1-4566-832b-e5244839a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Volume volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 (4ea0fd4f-80d2-4215-8c47-b2a47a1480b9): created successfully Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8a6828-e9e1-4566-832b-e5244839a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Flow 'volume_create_manager' (7f9fd353-ec23-492b-ab3c-66026415f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4ddf68a1-8dee-4f48-ba67-60efb85dda97 tempest-VolumesActionsTest-108144080 None] Created volume successfully. Feb 27 02:09:27 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 1.037s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_myy0s_jtdevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:27 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Converted 112.00 MB image at 107.95 MB/s Feb 27 02:09:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1G Feb 27 02:09:27 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 1G" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bccc8f-a7c4-449e-8e17-b986e1e170e5]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 1073741824" returned: 0 in 0.587s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 Feb 27 02:09:28 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:28 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" returned: 0 in 0.479s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99530137-13c0-4501-bad8-b45f3863621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad918ec-c17f-4469-8753-9af3981862dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:28 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Volume volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 (f55dea4e-5f59-4b50-901d-ab66bb6df1b2): created successfully Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad918ec-c17f-4469-8753-9af3981862dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Flow 'volume_create_manager' (0d25fbee-ff11-49e4-9aa2-1af331988998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-045bb98c-b8bc-48fd-997a-6a69f98ebb2b tempest-VolumesTransfersV355Test-365946687 None] Created volume successfully. Feb 27 02:09:28 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:28 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "cinder-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Acquiring lock "cinder-quobyte-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "cinder-quobyte-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fb4a4c-a475-4036-a5a7-6e7af1bb5236]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 Feb 27 02:09:29 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 1 in 0.596s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Downloaded image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume 1dcae118-27e0-4395-ae64-7aefffd23f50 successfully. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 for user c500b7b0ed934769bb80d4d8e62c3af9 is deleted. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Marking volume 1dcae118-27e0-4395-ae64-7aefffd23f50 as bootable. {{(pid=83211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Copying metadata from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 to 1dcae118-27e0-4395-ae64-7aefffd23f50. {{(pid=83211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Creating volume glance metadata for volume 1dcae118-27e0-4395-ae64-7aefffd23f50 backed by image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:09:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4749c685-7653-4273-b09a-f0baf72a6180 tempest-VolumesTransfersV355Test-2034175392 None] Transfer volume completed successfully. Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98432c4-ee38-4abc-9c06-6008a30ed54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcae118-27e0-4395-ae64-7aefffd23f50', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c5e926-bbc8-4c17-b0fc-ac5b050b04f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Volume volume-1dcae118-27e0-4395-ae64-7aefffd23f50 (1dcae118-27e0-4395-ae64-7aefffd23f50): created successfully Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c5e926-bbc8-4c17-b0fc-ac5b050b04f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Flow 'volume_create_manager' (4ae6985c-e1ce-422b-879b-579886918300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8f3f810f-cf8d-48e1-ad96-1cb097151390 tempest-VolumesExtendTest-1593699361 None] Created volume successfully. Feb 27 02:09:29 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" returned: 0 in 0.572s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9 Feb 27 02:09:29 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" returned: 0 in 0.423s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "cinder-quobyte-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9" released by "delete_volume" :: held 1.020s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Created reservations ['3c8d4651-6a69-4e5b-a460-7c3c0859f097', 'ea91302a-e8cb-4ea1-b5a4-c122f2d1c9b0', 'c0117cce-7fbf-478b-9a4c-3f5a2f86d099', '19ceadaa-b6d6-4eaf-86c7-674983f5d904'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:30 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "cinder-f55dea4e-5f59-4b50-901d-ab66bb6df1b2-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-f55dea4e-5f59-4b50-901d-ab66bb6df1b2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "cinder-quobyte-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-quobyte-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e6403-7cf0-481a-887b-7b8557ae4f0c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 Feb 27 02:09:30 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fea13a-73f7-4cc3-a204-b6183b3e6688]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.555s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:30 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Deleted volume successfully. Feb 27 02:09:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2a013618-1aa1-4c5d-a08f-d6ea2bb4e2ed tempest-VolumesActionsTest-108144080 None] Lock "cinder-4ea0fd4f-80d2-4215-8c47-b2a47a1480b9-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:31 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" returned: 0 in 0.631s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2 Feb 27 02:09:31 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:31 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" returned: 0 in 0.570s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-quobyte-f55dea4e-5f59-4b50-901d-ab66bb6df1b2" released by "delete_volume" :: held 1.224s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Created reservations ['4dd64cda-5c4b-4721-9cc0-8180b72a8ec5', '285ef69b-d888-4476-93a0-df5e5f0b6a99', 'de285f04-c2a2-4c04-b6d1-322c13fb8dcc', '80d9220d-ab0e-4027-9484-4174cce67efa'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:31 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 1 in 0.643s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 2G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 2G" returned: 0 in 0.052s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.328s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:32 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e3e5f489-7d63-4627-afa7-5526d2f1e354 tempest-VolumesExtendTest-1593699361 None] Extend volume completed successfully. Feb 27 02:09:32 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.541s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:32 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Deleted volume successfully. Feb 27 02:09:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8897d469-55b0-4b32-a3f5-8c0857f12f56 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-f55dea4e-5f59-4b50-901d-ab66bb6df1b2-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Flow 'volume_create_manager' (8f8818b2-c9c6-4960-af1a-b8aae5d76dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f314afc-fcd5-4707-a547-24996ecadcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f314afc-fcd5-4707-a547-24996ecadcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1524908115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6275e11a-c061-481f-aeb6-daf71d89df19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49560fb2d55d4be0916c9589b86d5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='ada9f0cdfed44c69ad1d657e347eed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee5a260-248d-4dfe-9569-da1386c0562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee5a260-248d-4dfe-9569-da1386c0562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c2863-a8ad-493c-b04e-2b94812a8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243c2863-a8ad-493c-b04e-2b94812a8adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6275e11a-c061-481f-aeb6-daf71d89df19', 'volume_name': 'volume-6275e11a-c061-481f-aeb6-daf71d89df19', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82f522-167b-4a07-a1fe-4d7710ac192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82f522-167b-4a07-a1fe-4d7710ac192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c380da95-6b81-428b-9357-40fa31b5eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Volume 6275e11a-c061-481f-aeb6-daf71d89df19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6275e11a-c061-481f-aeb6-daf71d89df19', 'volume_size': 1} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1524908115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6275e11a-c061-481f-aeb6-daf71d89df19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49560fb2d55d4be0916c9589b86d5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='ada9f0cdfed44c69ad1d657e347eed88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Creating volume 6275e11a-c061-481f-aeb6-daf71d89df19 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:33 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-1dcae118-27e0-4395-ae64-7aefffd23f50-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-1dcae118-27e0-4395-ae64-7aefffd23f50-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:33 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 1073741824 Feb 27 02:09:33 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-quobyte-1dcae118-27e0-4395-ae64-7aefffd23f50" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-1dcae118-27e0-4395-ae64-7aefffd23f50" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531ee01-0a7d-4bb9-b350-58975084e14d]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:33 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 1073741824" returned: 0 in 0.769s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 0.688s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 Feb 27 02:09:33 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:34 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19" returned: 0 in 0.539s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c380da95-6b81-428b-9357-40fa31b5eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6275e11a-c061-481f-aeb6-daf71d89df19', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b1f1df-a514-497b-b9a0-d96a388857c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:34 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Volume volume-6275e11a-c061-481f-aeb6-daf71d89df19 (6275e11a-c061-481f-aeb6-daf71d89df19): created successfully Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b1f1df-a514-497b-b9a0-d96a388857c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Flow 'volume_create_manager' (8f8818b2-c9c6-4960-af1a-b8aae5d76dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f7cfa89d-c97e-4699-8b00-00ced39102fe tempest-VolumesTransfersV355Test-365946687 None] Created volume successfully. Feb 27 02:09:34 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 1 in 0.723s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50 Feb 27 02:09:34 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1dcae118-27e0-4395-ae64-7aefffd23f50" returned: 0 in 0.566s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-1dcae118-27e0-4395-ae64-7aefffd23f50" released by "delete_volume" :: held 2.032s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Created reservations ['b3911efb-ead4-4166-a130-794beaf08492', 'f418700f-70e7-4e1d-a2d2-2ab55c4c558b', '36d8bc7c-d513-4a22-80ec-ef39a7638585', 'db2baae0-c87f-4f0c-94b3-78f4c15595f2'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:35 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "cinder-6275e11a-c061-481f-aeb6-daf71d89df19-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Acquiring lock "cinder-7d1f8b9f-2ab6-4354-8440-de5393858942-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-6275e11a-c061-481f-aeb6-daf71d89df19-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "cinder-7d1f8b9f-2ab6-4354-8440-de5393858942-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "cinder-quobyte-6275e11a-c061-481f-aeb6-daf71d89df19" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Acquiring lock "cinder-quobyte-7d1f8b9f-2ab6-4354-8440-de5393858942" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-quobyte-6275e11a-c061-481f-aeb6-daf71d89df19" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "cinder-quobyte-7d1f8b9f-2ab6-4354-8440-de5393858942" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7e2c0-f46f-4281-832d-dc0a7048f8b4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7cc1d-3800-4e9f-a298-3607cc18bdad]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 Feb 27 02:09:35 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 Feb 27 02:09:35 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.480s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Deleted volume successfully. Feb 27 02:09:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1815b7b6-3fdf-46e8-aaf3-d954c7788dd3 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-1dcae118-27e0-4395-ae64-7aefffd23f50-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:36 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942" returned: 0 in 0.588s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942 Feb 27 02:09:36 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19" returned: 0 in 0.635s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19 Feb 27 02:09:36 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Flow 'volume_create_manager' (521b12fd-2284-4ca7-812d-320a69a384d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c024faea-1a14-45fc-8187-3a70d11de75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c024faea-1a14-45fc-8187-3a70d11de75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-767106561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4fee36-d0f1-432e-9170-bd0f8b94971d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea2a09e6dc84d5895f6a7b094de119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='c500b7b0ed934769bb80d4d8e62c3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce9a4cf-456c-4d4c-91c5-a5f70a9fea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce9a4cf-456c-4d4c-91c5-a5f70a9fea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f530b878-f805-4d68-889a-dfb1a9c93664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f530b878-f805-4d68-889a-dfb1a9c93664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4fee36-d0f1-432e-9170-bd0f8b94971d', 'volume_name': 'volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a07be9b-7ffb-4bfb-b439-23e187836de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a07be9b-7ffb-4bfb-b439-23e187836de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3140f3d2-4668-4273-83c3-d08290cf18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Volume 5a4fee36-d0f1-432e-9170-bd0f8b94971d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d', 'volume_size': 1} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-767106561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4fee36-d0f1-432e-9170-bd0f8b94971d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea2a09e6dc84d5895f6a7b094de119a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:37Z,use_quota=True,user_id='c500b7b0ed934769bb80d4d8e62c3af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Creating volume 5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:36 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d 1073741824 Feb 27 02:09:36 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-6275e11a-c061-481f-aeb6-daf71d89df19" returned: 0 in 0.602s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-quobyte-6275e11a-c061-481f-aeb6-daf71d89df19" released by "delete_volume" :: held 1.268s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:36 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7d1f8b9f-2ab6-4354-8440-de5393858942" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "cinder-quobyte-7d1f8b9f-2ab6-4354-8440-de5393858942" released by "delete_volume" :: held 1.275s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Created reservations ['2fe6bbc7-c854-4a11-8b5a-e8d1b8121762', '1643fdb0-f746-4e76-a844-14024f8ab435', '93766c77-55d0-412e-9d95-0bcbd9acfa52', '40ac6ce4-3eeb-4dc2-bb55-f7a4243f4017'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:36 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Created reservations ['b3041eed-eb07-4a60-9da9-6e76cf022230', 'de1751c0-2f73-4841-9d91-ac7f8f2cbe70', 'ca516bbc-a187-4d4e-ac45-71de9eada09d', '99d1ddf0-17f3-45a5-b396-52a431649479'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:37 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:37 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:37 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d 1073741824" returned: 0 in 0.660s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.533s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Deleted volume successfully. Feb 27 02:09:37 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12279a65-9ff2-4e30-a15c-a9d75746b4b4 tempest-VolumesTransfersV355Test-1706090706 None] Lock "cinder-6275e11a-c061-481f-aeb6-daf71d89df19-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.634s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Deleted volume successfully. Feb 27 02:09:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4bd848df-f645-46b9-89fc-c853e4c9dff6 tempest-VolumesNegativeTest-2089688343 None] Lock "cinder-7d1f8b9f-2ab6-4354-8440-de5393858942-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:38 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.574s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3140f3d2-4668-4273-83c3-d08290cf18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d9c426-35b5-4423-8297-1e8f85058dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Volume volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d (5a4fee36-d0f1-432e-9170-bd0f8b94971d): created successfully Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d9c426-35b5-4423-8297-1e8f85058dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Flow 'volume_create_manager' (521b12fd-2284-4ca7-812d-320a69a384d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:38 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9bffacb7-597f-46d1-a5e7-50dfaef067f9 tempest-VolumesExtendTest-1593699361 None] Created volume successfully. Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Creating offline snapshot 4990b696-bc0d-4298-8eb4-642691e4741e of volume 5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a24595-ea9e-49ab-9e50-76e4f8d4be5d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:39 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.847s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e 1G Feb 27 02:09:39 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e 1G" returned: 0 in 0.754s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e Feb 27 02:09:40 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Flow 'volume_create_manager' (952b0a71-bf67-4d55-8995-46d12bfef69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd66b1b3-0e52-4e25-9323-e6beeaac1cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd66b1b3-0e52-4e25-9323-e6beeaac1cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-66885334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2579cc1-3306-4f23-a82a-54043fd8fc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9935addede94490182c9929483fa3334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:41Z,use_quota=True,user_id='cb6a0fcd417444559d51dd0ca87854bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60eacc7-4d59-4524-9416-6b6727f3f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60eacc7-4d59-4524-9416-6b6727f3f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d144fc2-cfdf-41f9-87cb-cf476582a15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[83211]: DEBUG cinder.image.glance [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Creating Keystone auth plugin from conf {{(pid=83211) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d144fc2-cfdf-41f9-87cb-cf476582a15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2579cc1-3306-4f23-a82a-54043fd8fc79', 'volume_name': 'volume-b2579cc1-3306-4f23-a82a-54043fd8fc79', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a3ab51-e796-49c4-bfe9-c7b0179cf592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a3ab51-e796-49c4-bfe9-c7b0179cf592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb0975-516b-4645-bd72-f49367482abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Volume b2579cc1-3306-4f23-a82a-54043fd8fc79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2579cc1-3306-4f23-a82a-54043fd8fc79', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Trying to clone b2579cc1-3306-4f23-a82a-54043fd8fc79 from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]). {{(pid=83211) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:09:41 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e" returned: 0 in 0.756s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e is being set with open permissions: ugo+rw Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e Feb 27 02:09:41 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:09:41 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990c0c9-cad6-466c-b196-a6223f6d54fd]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD Feb 27 02:09:41 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e" returned: 0 in 0.622s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info Feb 27 02:09:42 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 is fetched for user cb6a0fcd417444559d51dd0ca87854bb. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf7b91-e14c-4975-bdee-50af48cd24c1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD Feb 27 02:09:42 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info" returned: 0 in 0.533s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info is being set with open permissions: ugo+rw Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info Feb 27 02:09:42 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD" returned: 0 in 0.606s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:43 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.info" returned: 0 in 0.566s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.152s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-66885334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2579cc1-3306-4f23-a82a-54043fd8fc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9935addede94490182c9929483fa3334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:41Z,use_quota=True,user_id='cb6a0fcd417444559d51dd0ca87854bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Creating volume b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:43 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6afb4225-e971-4c21-96c8-5d9edfdad424 tempest-VolumesExtendTest-1593699361 None] Create snapshot completed successfully Feb 27 02:09:43 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1073741824 Feb 27 02:09:43 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1073741824" returned: 0 in 0.573s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:43 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 0 in 0.514s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Attempting download of 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume b2579cc1-3306-4f23-a82a-54043fd8fc79. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cf1146-b79e-4ab4-ba1c-28d0e51a5967]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[592fb3fd-668b-4414-a7b2-4f6d999fa51b]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:44 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq Feb 27 02:09:44 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (9d5132db-a795-40c7-a183-993b6297c6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5f6fd0-e885-4b7b-b144-d4bdfa674eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5f6fd0-e885-4b7b-b144-d4bdfa674eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-142310914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2236b1-dac2-4b17-b38a-57304872ff20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab2b7a-45db-4bb1-b747-80d3dfc4268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab2b7a-45db-4bb1-b747-80d3dfc4268e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df099b-4054-4692-8f6c-2a8e07a50dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df099b-4054-4692-8f6c-2a8e07a50dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2236b1-dac2-4b17-b38a-57304872ff20', 'volume_name': 'volume-be2236b1-dac2-4b17-b38a-57304872ff20', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6a670f-198d-45d6-a632-e53c030be0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6a670f-198d-45d6-a632-e53c030be0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d86885-6fd9-4c65-bc12-76e841b25762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Volume be2236b1-dac2-4b17-b38a-57304872ff20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2236b1-dac2-4b17-b38a-57304872ff20', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (f4998673-d10c-4453-9358-1cf96433e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01807dc4-cd35-4e52-9aba-2b4b3fc38052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01807dc4-cd35-4e52-9aba-2b4b3fc38052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702416320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e973f054-9d60-4f2f-93a6-e11c0eea8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff6b7f-0aec-4494-9fd6-8e640f29cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ff6b7f-0aec-4494-9fd6-8e640f29cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156e0a45-ebe7-42b6-84b9-659c61a6b237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156e0a45-ebe7-42b6-84b9-659c61a6b237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e973f054-9d60-4f2f-93a6-e11c0eea8f9e', 'volume_name': 'volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a032935-bb9c-4438-b55e-2b041924c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a032935-bb9c-4438-b55e-2b041924c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8499520-3744-4791-9b5b-b627e3d40f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Volume e973f054-9d60-4f2f-93a6-e11c0eea8f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e', 'volume_size': 1} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq" returned: 0 in 0.774s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq Feb 27 02:09:45 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.988s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e 2G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e 2G" returned: 0 in 0.123s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.135s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-142310914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2236b1-dac2-4b17-b38a-57304872ff20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Creating volume be2236b1-dac2-4b17-b38a-57304872ff20 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:45 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 1073741824 Feb 27 02:09:45 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (b4b03de9-26c8-40dc-b014-c64e489c15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521a4855-744a-4269-bfb3-d3e099f755a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521a4855-744a-4269-bfb3-d3e099f755a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971181158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f573042b-233f-4545-8a41-825c2dae737e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8862f79c-51cc-4fed-8f11-d6875964dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8862f79c-51cc-4fed-8f11-d6875964dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf97794d-ea3b-4aa1-8623-21b0e212dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf97794d-ea3b-4aa1-8623-21b0e212dc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f573042b-233f-4545-8a41-825c2dae737e', 'volume_name': 'volume-f573042b-233f-4545-8a41-825c2dae737e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae44ea93-ab73-4486-9553-13255ce7f76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae44ea93-ab73-4486-9553-13255ce7f76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dbb8a7-a707-4fda-b939-4a1c5df2e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Volume f573042b-233f-4545-8a41-825c2dae737e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f573042b-233f-4545-8a41-825c2dae737e', 'volume_size': 1} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-70791270-211c-4eb1-8a14-5fc8fa49318f tempest-VolumesExtendTest-1593699361 None] Extend volume completed successfully. Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (b9bce065-a114-4ffc-b9d7-e7e3838b3599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1be718-3378-43f0-ad09-afe9f75d781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1be718-3378-43f0-ad09-afe9f75d781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431444804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c76025-7561-4aae-b525-fef68d8293d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:46Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7f1a5b-3991-4b13-bbf0-93854496f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7f1a5b-3991-4b13-bbf0-93854496f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94083b-c79f-403d-bf36-fe9b8519ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94083b-c79f-403d-bf36-fe9b8519ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c76025-7561-4aae-b525-fef68d8293d8', 'volume_name': 'volume-b7c76025-7561-4aae-b525-fef68d8293d8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f20b3e-f64f-42e2-ba05-3c9cc3fb291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f20b3e-f64f-42e2-ba05-3c9cc3fb291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508dbca1-00b1-4b75-8ac2-7ba7f2dc602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Volume b7c76025-7561-4aae-b525-fef68d8293d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c76025-7561-4aae-b525-fef68d8293d8', 'volume_size': 1} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:46 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq" returned: 1 in 0.973s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_362137d4-09ea-4da7-92c5-9fdbd53eaec8_wtthtmiq' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dd62d-7889-4af1-ba44-d7d776863764]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (ea6be90d-2111-4b7b-baa3-eb9f3af1a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3939c71-251f-4ccd-8acf-ee13f5b7a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD Feb 27 02:09:46 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3939c71-251f-4ccd-8acf-ee13f5b7a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-333019498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:46Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0339f5a4-0b86-4a68-af24-4826f0a5026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0339f5a4-0b86-4a68-af24-4826f0a5026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755b2dca-c587-4be2-8761-4318126ac181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755b2dca-c587-4be2-8761-4318126ac181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634', 'volume_name': 'volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334e9cf9-7d46-4e1c-893c-ba73cd9b85d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334e9cf9-7d46-4e1c-893c-ba73cd9b85d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa26c8c-b74d-456b-b644-afa1c338f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:46 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Volume 50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634', 'volume_size': 1} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 1073741824" returned: 0 in 0.835s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 Feb 27 02:09:46 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-4990b696-bc0d-4298-8eb4-642691e4741e-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] 362137d4-09ea-4da7-92c5-9fdbd53eaec8 was qcow2, converting to raw {{(pid=83211) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-4990b696-bc0d-4298-8eb4-642691e4741e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-quobyte-4990b696-bc0d-4298-8eb4-642691e4741e" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:46 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:46 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-4990b696-bc0d-4298-8eb4-642691e4741e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Deleting offline snapshot 4990b696-bc0d-4298-8eb4-642691e4741e of volume 5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] snapshot_file for this snap is: volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b2df0f-b530-4d22-8136-586f4653fe9f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e Feb 27 02:09:47 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20" returned: 0 in 0.826s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1702416320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e973f054-9d60-4f2f-93a6-e11c0eea8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Creating volume e973f054-9d60-4f2f-93a6-e11c0eea8f9e {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:47 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d86885-6fd9-4c65-bc12-76e841b25762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2236b1-dac2-4b17-b38a-57304872ff20', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331191de-033a-46e7-b9a2-891228cdf561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e 1073741824 Feb 27 02:09:47 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Volume volume-be2236b1-dac2-4b17-b38a-57304872ff20 (be2236b1-dac2-4b17-b38a-57304872ff20): created successfully Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331191de-033a-46e7-b9a2-891228cdf561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (9d5132db-a795-40c7-a183-993b6297c6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-7462d16f-d09f-4077-8ca6-c70229e7ada0 tempest-CreateVolumesFromImageTest-1542076344 None] Created volume successfully. Feb 27 02:09:47 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e" returned: 0 in 0.950s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c1e974-50a4-409f-b807-097e9dcb2f87]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:47 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e 1073741824" returned: 0 in 0.778s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e Feb 27 02:09:48 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 0 in 1.480s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_362137d4-09ea-4da7-92c5-9fdbd53eaec8_z8vpu4xpdevstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:48 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Converted 112.00 MB image at 75.59 MB/s Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1G Feb 27 02:09:48 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.776s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e Feb 27 02:09:48 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" returned: 0 in 0.578s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971181158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f573042b-233f-4545-8a41-825c2dae737e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Creating volume f573042b-233f-4545-8a41-825c2dae737e {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:48 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8499520-3744-4791-9b5b-b627e3d40f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd2661e-af0c-4e93-8f78-41dac961bf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:48 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Volume volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e (e973f054-9d60-4f2f-93a6-e11c0eea8f9e): created successfully Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd2661e-af0c-4e93-8f78-41dac961bf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:48 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e 1073741824 Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (f4998673-d10c-4453-9358-1cf96433e098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:48 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f3fc32e7-66f6-4c95-84b8-cf75830c7398 tempest-CreateVolumesFromImageTest-1542076344 None] Created volume successfully. Feb 27 02:09:48 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 1G" returned: 0 in 0.614s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cea0c3-88a4-4688-abce-4949ff1a8a87]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:49 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e Feb 27 02:09:49 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e 1073741824" returned: 0 in 0.757s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e Feb 27 02:09:49 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 0 in 0.626s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:49 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d.4990b696-bc0d-4298-8eb4-642691e4741e" returned: 0 in 0.605s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-4990b696-bc0d-4298-8eb4-642691e4741e" released by "_delete_snapshot" :: held 2.993s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" released by "delete_snapshot" :: held 3.013s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Created reservations ['bb2b5f2a-5959-4f9e-be7a-aebedc71fd56', '8bea1612-7af4-4a30-8deb-a95b9b3159f3', '245348ea-bdb4-4b32-93a6-ef90caf77eb2', 'bc4c57c4-aca8-407e-96d8-0087ac859110'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Delete snapshot completed successfully. Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c5b95863-a08f-4675-beba-43f2df1cf863 tempest-VolumesExtendTest-1593699361 None] Lock "cinder-4990b696-bc0d-4298-8eb4-642691e4741e-delete_snapshot" released by "delete_snapshot" :: held 3.208s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:50 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e" returned: 0 in 0.660s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.109s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431444804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c76025-7561-4aae-b525-fef68d8293d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:46Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Creating volume b7c76025-7561-4aae-b525-fef68d8293d8 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dbb8a7-a707-4fda-b939-4a1c5df2e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f573042b-233f-4545-8a41-825c2dae737e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae19ef3-7ea0-4363-ab25-1302017f8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Volume volume-f573042b-233f-4545-8a41-825c2dae737e (f573042b-233f-4545-8a41-825c2dae737e): created successfully Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae19ef3-7ea0-4363-ab25-1302017f8192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (b4b03de9-26c8-40dc-b014-c64e489c15f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:50 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 1073741824 Feb 27 02:09:50 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0d553b59-664f-49d0-a123-c65583a66bc8 tempest-CreateVolumesFromImageTest-1542076344 None] Created volume successfully. Feb 27 02:09:50 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 1 in 0.775s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Downloaded image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 ((None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}])) to volume b2579cc1-3306-4f23-a82a-54043fd8fc79 successfully. {{(pid=83211) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Temporary image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 for user cb6a0fcd417444559d51dd0ca87854bb is deleted. {{(pid=83211) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.volume_utils [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Marking volume b2579cc1-3306-4f23-a82a-54043fd8fc79 as bootable. {{(pid=83211) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Copying metadata from image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 to b2579cc1-3306-4f23-a82a-54043fd8fc79. {{(pid=83211) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Creating volume glance metadata for volume b2579cc1-3306-4f23-a82a-54043fd8fc79 backed by image 362137d4-09ea-4da7-92c5-9fdbd53eaec8 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83211) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cb0975-516b-4645-bd72-f49367482abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2579cc1-3306-4f23-a82a-54043fd8fc79', 'volume_size': 1, 'image_id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '903ff061dd9b42b888c1f2da3124769d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '362137d4-09ea-4da7-92c5-9fdbd53eaec8', 'created_at': datetime.datetime(2026, 2, 27, 0, 58, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 58, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/362137d4-09ea-4da7-92c5-9fdbd53eaec8/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d60e35-8900-41b4-9292-535189ec8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Volume volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 (b2579cc1-3306-4f23-a82a-54043fd8fc79): created successfully Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d60e35-8900-41b4-9292-535189ec8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Flow 'volume_create_manager' (952b0a71-bf67-4d55-8995-46d12bfef69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-aa966687-735c-425a-adeb-3119e119467e tempest-VolumesImageMetadata-622143163 None] Created volume successfully. Feb 27 02:09:50 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 1073741824" returned: 0 in 0.799s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 Feb 27 02:09:51 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-5a4fee36-d0f1-432e-9170-bd0f8b94971d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Acquiring lock "cinder-b2579cc1-3306-4f23-a82a-54043fd8fc79-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "cinder-5a4fee36-d0f1-432e-9170-bd0f8b94971d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "cinder-b2579cc1-3306-4f23-a82a-54043fd8fc79-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Acquiring lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Acquiring lock "cinder-quobyte-b2579cc1-3306-4f23-a82a-54043fd8fc79" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "cinder-quobyte-b2579cc1-3306-4f23-a82a-54043fd8fc79" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9724c-ad3e-41dd-8960-5fdcf6abbe09]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24ab590-0213-443f-b1b7-ca18ee19fcf5]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:51 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:51 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8" returned: 0 in 0.704s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.292s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-333019498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb7ffa3c80a42c087ad631b14d2b08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:46Z,use_quota=True,user_id='3f2151d1910e44edb949f69fd157128f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Creating volume 50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:51 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 1073741824 Feb 27 02:09:51 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508dbca1-00b1-4b75-8ac2-7ba7f2dc602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c76025-7561-4aae-b525-fef68d8293d8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faab0e36-0b6a-4329-b01b-921017b84b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Volume volume-b7c76025-7561-4aae-b525-fef68d8293d8 (b7c76025-7561-4aae-b525-fef68d8293d8): created successfully Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faab0e36-0b6a-4329-b01b-921017b84b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (b9bce065-a114-4ffc-b9d7-e7e3838b3599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8439823f-6cc6-44c4-898b-a1dd9db62d67 tempest-CreateVolumesFromImageTest-1542076344 None] Created volume successfully. Feb 27 02:09:52 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.726s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 0 in 0.708s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d Feb 27 02:09:52 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:52 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 1073741824" returned: 0 in 0.658s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 Feb 27 02:09:52 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5a4fee36-d0f1-432e-9170-bd0f8b94971d" returned: 0 in 0.620s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "cinder-quobyte-5a4fee36-d0f1-432e-9170-bd0f8b94971d" released by "delete_volume" :: held 1.395s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 1 in 0.624s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79 Feb 27 02:09:52 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Created reservations ['933f8ada-6afa-49bd-be68-ef18be750e8f', 'e036e7d2-ee40-4f3b-bee2-4421de21ec6b', '367651f5-2563-4368-8cd6-478b3ee8ba59', '4862df30-9dba-4685-a35c-08187dd94ee1'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:52 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" returned: 0 in 0.518s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa26c8c-b74d-456b-b644-afa1c338f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673f5d57-b7ac-468a-b7ca-b7dfb0847c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Volume volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 (50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634): created successfully Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673f5d57-b7ac-468a-b7ca-b7dfb0847c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Flow 'volume_create_manager' (ea6be90d-2111-4b7b-baa3-eb9f3af1a37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f854d392-5c8f-4d5c-8537-f8fa371e1d24 tempest-CreateVolumesFromImageTest-1542076344 None] Created volume successfully. Feb 27 02:09:53 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2579cc1-3306-4f23-a82a-54043fd8fc79" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "cinder-quobyte-b2579cc1-3306-4f23-a82a-54043fd8fc79" released by "delete_volume" :: held 1.884s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Created reservations ['b113f112-d5d8-4ffa-b465-4d959476628f', '9164bc3a-1140-460c-aee4-1ec2233894f8', '09f0dff0-3ad0-4cc6-8721-29543910a045', '9659a9dd-1e9f-411f-9a12-f4ea0982dd1d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:53 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.574s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Deleted volume successfully. Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a44976af-3910-4806-94eb-2dd1fccc257f tempest-VolumesExtendTest-1593699361 None] Lock "cinder-5a4fee36-d0f1-432e-9170-bd0f8b94971d-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.535s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Deleted volume successfully. Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-98969882-3e6e-4e87-9e63-9b5d95e93f6e tempest-VolumesImageMetadata-622143163 None] Lock "cinder-b2579cc1-3306-4f23-a82a-54043fd8fc79-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-quobyte-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a98a7b-8a3e-4442-8122-d93d43a913fd]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 Feb 27 02:09:54 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" returned: 0 in 0.650s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634 Feb 27 02:09:54 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" returned: 0 in 0.543s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634" released by "delete_volume" :: held 1.230s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Created reservations ['c1c55070-eb29-44c7-8451-26e541c6780b', 'f63b9cad-9bd7-4447-9622-27f315ab8f08', 'eaddba63-3367-4275-9b5b-0808f2a29d9e', 'c7074e0a-e031-426f-b005-e498a197a6c3'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:55 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.637s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Deleted volume successfully. Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=142,cinder:INSERT=61,cinder:UPDATE=198,cinder:DELETE=21 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e206a068-5253-4c62-a04a-bbf810021383 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-50bcc4c0-6baf-41f3-8aa3-ec9ca3d6b634-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-b7c76025-7561-4aae-b525-fef68d8293d8-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-b7c76025-7561-4aae-b525-fef68d8293d8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=149,cinder:UPDATE=212,cinder:INSERT=57,cinder:DELETE=15 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-quobyte-b7c76025-7561-4aae-b525-fef68d8293d8" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Flow 'volume_create_manager' (6ed4be4f-3012-4438-865d-d0e2da0857dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eabc813-860d-4a59-b0c0-0ab8b907fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-b7c76025-7561-4aae-b525-fef68d8293d8" acquired by "delete_volume" :: waited 0.083s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eabc813-860d-4a59-b0c0-0ab8b907fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-846526170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07925b61-8fcd-410f-8907-6086648f150f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53cd274cb704f328837a8d1fabd993f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:56Z,use_quota=True,user_id='be5f3df7038640e299380819250ce18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d54f36-f68e-40ab-9da1-5865643e495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d54f36-f68e-40ab-9da1-5865643e495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f6bdd1-3500-4dcb-a307-eeb38b34b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f6bdd1-3500-4dcb-a307-eeb38b34b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07925b61-8fcd-410f-8907-6086648f150f', 'volume_name': 'volume-07925b61-8fcd-410f-8907-6086648f150f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a414f-6e0f-4367-a5db-953f17dff41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a414f-6e0f-4367-a5db-953f17dff41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fb1dec-f4f0-4214-be17-f1493d354d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Volume 07925b61-8fcd-410f-8907-6086648f150f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07925b61-8fcd-410f-8907-6086648f150f', 'volume_size': 1} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-846526170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07925b61-8fcd-410f-8907-6086648f150f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53cd274cb704f328837a8d1fabd993f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:56Z,use_quota=True,user_id='be5f3df7038640e299380819250ce18d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Creating volume 07925b61-8fcd-410f-8907-6086648f150f {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:56 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb300f6-2a4d-4cd6-8459-6ba503fe959a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f 1073741824 Feb 27 02:09:56 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 Feb 27 02:09:56 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8" returned: 0 in 0.784s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8 Feb 27 02:09:57 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f 1073741824" returned: 0 in 0.838s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f Feb 27 02:09:57 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b7c76025-7561-4aae-b525-fef68d8293d8" returned: 0 in 0.531s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-b7c76025-7561-4aae-b525-fef68d8293d8" released by "delete_volume" :: held 1.437s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Created reservations ['84c830c0-44f1-40f8-877f-d996533f23e2', '30ec882e-895e-4ee7-9f46-dceea2829798', 'a06fe359-73fe-426e-8e20-6ce37a21d6bc', 'de2ff318-85a2-49bd-a506-934fa813cd9b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f" returned: 0 in 0.671s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:09:57 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fb1dec-f4f0-4214-be17-f1493d354d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07925b61-8fcd-410f-8907-6086648f150f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b36f52f-a9fb-4176-8a9e-ffb5411196d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:58 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Volume volume-07925b61-8fcd-410f-8907-6086648f150f (07925b61-8fcd-410f-8907-6086648f150f): created successfully Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b36f52f-a9fb-4176-8a9e-ffb5411196d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Flow 'volume_create_manager' (6ed4be4f-3012-4438-865d-d0e2da0857dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4bd1e6d3-3765-41b8-b0fb-73b305cfe052 tempest-VolumesMetadataTest-1004166195 None] Created volume successfully. Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-f573042b-233f-4545-8a41-825c2dae737e-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-f573042b-233f-4545-8a41-825c2dae737e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-quobyte-f573042b-233f-4545-8a41-825c2dae737e" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-f573042b-233f-4545-8a41-825c2dae737e" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeebbc74-83bb-4855-a999-e8a12520ebdb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.800s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Deleted volume successfully. Feb 27 02:09:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4163761a-470a-4af7-bac5-e8396941a319 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-b7c76025-7561-4aae-b525-fef68d8293d8-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:58 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e Feb 27 02:09:58 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Acquiring lock "cinder-07925b61-8fcd-410f-8907-6086648f150f-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "cinder-07925b61-8fcd-410f-8907-6086648f150f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Acquiring lock "cinder-quobyte-07925b61-8fcd-410f-8907-6086648f150f" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "cinder-quobyte-07925b61-8fcd-410f-8907-6086648f150f" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961c315-1faf-4c4b-a44f-5072b09ab073]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e" returned: 0 in 0.842s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f Feb 27 02:09:59 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e Feb 27 02:09:59 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f573042b-233f-4545-8a41-825c2dae737e" returned: 0 in 0.642s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-f573042b-233f-4545-8a41-825c2dae737e" released by "delete_volume" :: held 1.524s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Created reservations ['c20a9c66-3ec7-4850-8f83-102e906553ed', '56622bcb-4bb4-4616-908e-420a79f3bad6', 'f751c608-e2a1-4ef3-a26d-49cfe0fbb92f', '368554d2-8dd2-4c82-ac9d-2302e7fb4a97'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:00 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f" returned: 0 in 0.907s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f Feb 27 02:10:00 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:00 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-e973f054-9d60-4f2f-93a6-e11c0eea8f9e-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-e973f054-9d60-4f2f-93a6-e11c0eea8f9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-quobyte-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd5248e-2f7e-436b-ada4-c37c30e008ed]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.665s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:01 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Deleted volume successfully. Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-8da5ad5b-97bf-45de-ae76-4ebc752fbab0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-f573042b-233f-4545-8a41-825c2dae737e-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:01 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07925b61-8fcd-410f-8907-6086648f150f" returned: 0 in 0.814s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "cinder-quobyte-07925b61-8fcd-410f-8907-6086648f150f" released by "delete_volume" :: held 1.749s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:01 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e Feb 27 02:10:01 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Created reservations ['7b821aa0-fc96-4f59-93fb-a563f01bb329', '6bf98e9f-4c81-4f3b-b39b-018cf5c9d063', 'd9b31cec-5387-42be-aefd-5044c84c2e63', 'f86d4b65-21c1-4ec6-8119-7b786c95ef20'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:01 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" returned: 0 in 1.024s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e Feb 27 02:10:02 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.220s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:02 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Deleted volume successfully. Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d6575902-bef0-4929-89c6-6fd545c60008 tempest-VolumesMetadataTest-1004166195 None] Lock "cinder-07925b61-8fcd-410f-8907-6086648f150f-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:02 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" returned: 0 in 0.726s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-e973f054-9d60-4f2f-93a6-e11c0eea8f9e" released by "delete_volume" :: held 1.789s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Created reservations ['0194b6c8-68e8-4a4f-bcbc-a331cd239ddc', '0a210ffe-2ff9-4efd-b611-2013d9fda855', '8a81d84a-ca44-4b26-8c06-e1bc9dcc54f3', '6a4f0cb4-81ba-47b9-a9e3-a1c42753f608'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:03 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Flow 'volume_create_manager' (f55dea0a-b6e5-4753-816c-cdc5299aa292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0fcbe8-46a9-49a1-9ddf-a5a681eeaa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0fcbe8-46a9-49a1-9ddf-a5a681eeaa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-22799564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21f13e2-475a-4aad-a961-b5c17d254a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c2d399bf3441da919b6a1dd2304ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:03Z,use_quota=True,user_id='a1c7edb98be34da3b22fefd13017cf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc35ceba-dc8f-446c-990a-d3f668063688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc35ceba-dc8f-446c-990a-d3f668063688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d44c79-b99d-4087-b663-0c224e3cce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d44c79-b99d-4087-b663-0c224e3cce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21f13e2-475a-4aad-a961-b5c17d254a06', 'volume_name': 'volume-b21f13e2-475a-4aad-a961-b5c17d254a06', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf0e2f-89e3-4f12-8c41-ddd326d85f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabf0e2f-89e3-4f12-8c41-ddd326d85f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d92e7-c448-41b6-8565-c1214fbbfcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Volume b21f13e2-475a-4aad-a961-b5c17d254a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21f13e2-475a-4aad-a961-b5c17d254a06', 'volume_size': 1} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-22799564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21f13e2-475a-4aad-a961-b5c17d254a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c2d399bf3441da919b6a1dd2304ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:03Z,use_quota=True,user_id='a1c7edb98be34da3b22fefd13017cf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Creating volume b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:03 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-be2236b1-dac2-4b17-b38a-57304872ff20-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-be2236b1-dac2-4b17-b38a-57304872ff20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 1073741824 Feb 27 02:10:03 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "cinder-quobyte-be2236b1-dac2-4b17-b38a-57304872ff20" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-be2236b1-dac2-4b17-b38a-57304872ff20" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91f16b-3b51-400f-b9f8-0ee5d495cb12]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 Feb 27 02:10:03 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.739s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Deleted volume successfully. Feb 27 02:10:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-0a9e544c-03d5-47d5-830c-5bd1829c46f0 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-e973f054-9d60-4f2f-93a6-e11c0eea8f9e-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:04 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 1073741824" returned: 0 in 0.903s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:04 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20" returned: 0 in 0.978s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20 Feb 27 02:10:04 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-be2236b1-dac2-4b17-b38a-57304872ff20" returned: 0 in 0.713s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-quobyte-be2236b1-dac2-4b17-b38a-57304872ff20" released by "delete_volume" :: held 1.721s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Created reservations ['7122cd2d-5e01-495e-a7c7-b4dad61feabf', '81cebce9-41d9-4819-ad71-bb3534e16ad7', 'c4d63ca9-9e4a-41e1-9c0a-3a2034abc9e8', 'd8d91511-5e8c-4f45-9b4f-9c650a416aa6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:05 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.971s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d92e7-c448-41b6-8565-c1214fbbfcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21f13e2-475a-4aad-a961-b5c17d254a06', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944a9723-5f93-47b7-836d-84a7e2de01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:05 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Volume volume-b21f13e2-475a-4aad-a961-b5c17d254a06 (b21f13e2-475a-4aad-a961-b5c17d254a06): created successfully Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944a9723-5f93-47b7-836d-84a7e2de01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Flow 'volume_create_manager' (f55dea0a-b6e5-4753-816c-cdc5299aa292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-bc2a0ae2-f0c4-49a3-96d1-0e6f83796aab tempest-SnapshotDependencyTests-507906655 None] Created volume successfully. Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:05 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:05 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Deleted volume successfully. Feb 27 02:10:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-42bc57cd-8e22-4520-9551-46495a4ff679 tempest-CreateVolumesFromImageTest-1542076344 None] Lock "cinder-be2236b1-dac2-4b17-b38a-57304872ff20-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (393f21ef-8769-481a-b696-c744395e4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3dfb3-7722-4b33-9e35-7245b22d6b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3dfb3-7722-4b33-9e35-7245b22d6b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405684039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e96173-f709-4b16-bfe2-a4bb954d8b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:06Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bedba19-7e26-4a18-a6d5-66113d188ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bedba19-7e26-4a18-a6d5-66113d188ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3257a58-b45d-4a3a-8fb8-fa24da286b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3257a58-b45d-4a3a-8fb8-fa24da286b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e96173-f709-4b16-bfe2-a4bb954d8b2b', 'volume_name': 'volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f805f9d-e791-4ad1-824f-94c8db0bfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f805f9d-e791-4ad1-824f-94c8db0bfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7239dc-c958-45c1-a761-8d5ce93662e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Volume 61e96173-f709-4b16-bfe2-a4bb954d8b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b', 'volume_size': 1} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405684039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e96173-f709-4b16-bfe2-a4bb954d8b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:06Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Creating volume 61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:06 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:06 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b 1073741824 Feb 27 02:10:06 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:07 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b 1073741824" returned: 0 in 0.602s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b Feb 27 02:10:07 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Flow 'volume_create_manager' (8df2ba9f-30c9-496a-bffa-50b681037c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5b8c5-170c-4501-922c-225e8931ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5b8c5-170c-4501-922c-225e8931ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1371068894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62798796-e6e0-4200-a23a-dd05b90d13f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8c1bb9752143dc887a3c82b18dace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='cc5c709770a846abb3cb934316ccb073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8a4a2d-2330-483c-b75a-d48f62326a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8a4a2d-2330-483c-b75a-d48f62326a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a7b67-e3fb-4e71-bddd-e5e10e5fa946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507a7b67-e3fb-4e71-bddd-e5e10e5fa946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62798796-e6e0-4200-a23a-dd05b90d13f8', 'volume_name': 'volume-62798796-e6e0-4200-a23a-dd05b90d13f8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939e46ed-b431-43e9-a63f-6c6f58f3f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939e46ed-b431-43e9-a63f-6c6f58f3f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7421bd3-6135-4446-9e7b-6911281b8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Volume 62798796-e6e0-4200-a23a-dd05b90d13f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62798796-e6e0-4200-a23a-dd05b90d13f8', 'volume_size': 1} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:07 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b" returned: 0 in 0.630s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.255s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7239dc-c958-45c1-a761-8d5ce93662e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1508b525-ee3c-4261-afab-af5b24303f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Creating offline snapshot cf995153-bb7b-4312-ac18-ae80b129dffe of volume b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6d4f2-5167-49b1-bd3a-5a7fd7d5f634]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Volume volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b (61e96173-f709-4b16-bfe2-a4bb954d8b2b): created successfully Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1508b525-ee3c-4261-afab-af5b24303f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (393f21ef-8769-481a-b696-c744395e4001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-dde8e3f7-893e-4a1f-b349-7b53d2d827a5 tempest-VolumesSnapshotTestJSON-170796422 None] Created volume successfully. Feb 27 02:10:07 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:07 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.634s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:08 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe 1G Feb 27 02:10:08 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (5fcd0190-8d73-4700-aebe-f18281f31439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224e12c4-5dc7-4a85-b723-4d2122ab3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224e12c4-5dc7-4a85-b723-4d2122ab3aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045445385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ce651-a6a6-41f0-8c48-e9d088ca799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:09Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b8675-606c-4d30-8c22-b07c78c93136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b8675-606c-4d30-8c22-b07c78c93136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c906f2d-8710-464c-90d5-a6844436147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c906f2d-8710-464c-90d5-a6844436147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155ce651-a6a6-41f0-8c48-e9d088ca799e', 'volume_name': 'volume-155ce651-a6a6-41f0-8c48-e9d088ca799e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9120f7b-5497-4c95-8500-f1fff5e5da2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9120f7b-5497-4c95-8500-f1fff5e5da2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9106931-5815-4554-a081-26d87c133716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:08 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume 155ce651-a6a6-41f0-8c48-e9d088ca799e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155ce651-a6a6-41f0-8c48-e9d088ca799e', 'volume_size': 1} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:09 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe 1G" returned: 0 in 0.556s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21f13e2-475a-4aad-a961-b5c17d254a06 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:09 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21f13e2-475a-4aad-a961-b5c17d254a06 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:09 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:09 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b21f13e2-475a-4aad-a961-b5c17d254a06 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.501s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:09 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe is being set with open permissions: ugo+rw Feb 27 02:10:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:09 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:09 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:10 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.487s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:10 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info Feb 27 02:10:10 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:10 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info" returned: 0 in 0.515s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info is being set with open permissions: ugo+rw Feb 27 02:10:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:10 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info Feb 27 02:10:10 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.info" returned: 0 in 0.469s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.557s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1371068894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62798796-e6e0-4200-a23a-dd05b90d13f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8c1bb9752143dc887a3c82b18dace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='cc5c709770a846abb3cb934316ccb073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Creating volume 62798796-e6e0-4200-a23a-dd05b90d13f8 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:11 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 1073741824 Feb 27 02:10:11 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c3c9dc29-d726-4905-914e-f6bed604e679 tempest-SnapshotDependencyTests-507906655 None] Create snapshot completed successfully Feb 27 02:10:11 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 1073741824" returned: 0 in 0.612s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 Feb 27 02:10:11 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Flow 'volume_create_manager' (33be245d-838b-4f2c-810e-4faf2473a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af83d68-0e2f-4c6f-91af-fa9031a68ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af83d68-0e2f-4c6f-91af-fa9031a68ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4de5b8b-6a25-462a-904b-61150c3c89b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c2d399bf3441da919b6a1dd2304ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf995153-bb7b-4312-ac18-ae80b129dffe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:12Z,use_quota=True,user_id='a1c7edb98be34da3b22fefd13017cf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae06d1cf-210a-475d-8c39-93fa9d648432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae06d1cf-210a-475d-8c39-93fa9d648432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf336e80-1fa4-442d-8aa5-22f5f86b278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf336e80-1fa4-442d-8aa5-22f5f86b278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4de5b8b-6a25-462a-904b-61150c3c89b5', 'volume_name': 'volume-a4de5b8b-6a25-462a-904b-61150c3c89b5', 'volume_size': 1, 'snapshot_id': 'cf995153-bb7b-4312-ac18-ae80b129dffe'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ecdbb6-526a-4a51-9e58-fd466f821447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ecdbb6-526a-4a51-9e58-fd466f821447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12df830d-bd71-497c-975d-eb5b15386833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Volume a4de5b8b-6a25-462a-904b-61150c3c89b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4de5b8b-6a25-462a-904b-61150c3c89b5', 'volume_size': 1, 'snapshot_id': 'cf995153-bb7b-4312-ac18-ae80b129dffe'} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8" returned: 0 in 0.504s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045445385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ce651-a6a6-41f0-8c48-e9d088ca799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:09Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume 155ce651-a6a6-41f0-8c48-e9d088ca799e {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:12 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7421bd3-6135-4446-9e7b-6911281b8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62798796-e6e0-4200-a23a-dd05b90d13f8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9028bfc-1bce-4ffc-9c20-2322e65e84ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e 1073741824 Feb 27 02:10:12 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Volume volume-62798796-e6e0-4200-a23a-dd05b90d13f8 (62798796-e6e0-4200-a23a-dd05b90d13f8): created successfully Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9028bfc-1bce-4ffc-9c20-2322e65e84ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Flow 'volume_create_manager' (8df2ba9f-30c9-496a-bffa-50b681037c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c32376b1-1450-47c4-b167-8167d7c53a57 tempest-VolumesTransfersTest-1488624510 None] Created volume successfully. Feb 27 02:10:12 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e 1073741824" returned: 0 in 0.688s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:12 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e Feb 27 02:10:12 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e7c6c8e0-7533-4e5d-83cf-968816c4e5c3 tempest-VolumesTransfersTest-1316997705 None] Transfer volume completed successfully. Feb 27 02:10:13 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.546s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9106931-5815-4554-a081-26d87c133716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155ce651-a6a6-41f0-8c48-e9d088ca799e', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f5ea08-0e4f-4847-90d0-653d10d5ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-155ce651-a6a6-41f0-8c48-e9d088ca799e (155ce651-a6a6-41f0-8c48-e9d088ca799e): created successfully Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f5ea08-0e4f-4847-90d0-653d10d5ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (5fcd0190-8d73-4700-aebe-f18281f31439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:13 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Creating offline snapshot 34b497e2-145c-4e25-ba8d-3ce41187e079 of volume 61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88539d-284e-4cec-a491-d771e67a88a7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6e7abd4d-dcad-4ffb-ac01-d87dc390b412 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:13 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b Feb 27 02:10:13 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.483s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "cinder-62798796-e6e0-4200-a23a-dd05b90d13f8-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-62798796-e6e0-4200-a23a-dd05b90d13f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:14 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b" returned: 0 in 0.615s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "cinder-quobyte-62798796-e6e0-4200-a23a-dd05b90d13f8" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 1G Feb 27 02:10:14 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-quobyte-62798796-e6e0-4200-a23a-dd05b90d13f8" acquired by "delete_volume" :: waited 0.024s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3be46-ba66-4abb-8566-494b4d9b8749]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 Feb 27 02:10:14 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (06ad0c0e-47a7-4175-b290-fff69729087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474e9c2-fe35-4464-8114-7b842a2b4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474e9c2-fe35-4464-8114-7b842a2b4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966585699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c858a53f-90b0-456b-9112-56373f76cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:14Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7f2e68-3461-4fe0-91bb-fa046d15d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7f2e68-3461-4fe0-91bb-fa046d15d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53a5d50-3050-4cdb-88c7-520e090948c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53a5d50-3050-4cdb-88c7-520e090948c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c858a53f-90b0-456b-9112-56373f76cd0b', 'volume_name': 'volume-c858a53f-90b0-456b-9112-56373f76cd0b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296c306c-a4c2-4360-b85c-37f644dcfed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296c306c-a4c2-4360-b85c-37f644dcfed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd93aa13-8e8e-40c0-b7ba-962518da070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume c858a53f-90b0-456b-9112-56373f76cd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c858a53f-90b0-456b-9112-56373f76cd0b', 'volume_size': 1} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (1f8eb851-e49f-4193-b718-2f0f89050bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc27481e-fa61-410c-b88d-788fe4266a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc27481e-fa61-410c-b88d-788fe4266a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949045849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0762c41-77c8-4f69-adc4-ffff6a90c3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a010a76-e2f3-4d13-b614-5497e724651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a010a76-e2f3-4d13-b614-5497e724651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bd6560-1501-4c0c-b60b-ff26aaf35288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bd6560-1501-4c0c-b60b-ff26aaf35288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0762c41-77c8-4f69-adc4-ffff6a90c3bb', 'volume_name': 'volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e525d6e5-5061-40ff-bcc8-aee1f6648edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e525d6e5-5061-40ff-bcc8-aee1f6648edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d4b596-64a2-46ec-b30c-29b09e13a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume d0762c41-77c8-4f69-adc4-ffff6a90c3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb', 'volume_size': 1} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:14 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 1G" returned: 0 in 0.654s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 Feb 27 02:10:14 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8 Feb 27 02:10:14 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (cebff75a-e934-4496-85bf-9908e9865e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3e3df6-acc8-4427-a1bb-7ca769cca805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3e3df6-acc8-4427-a1bb-7ca769cca805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695427693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3415f9e1-c969-4bc8-9edd-188b2230c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3415f9e1-c969-4bc8-9edd-188b2230c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c2b6c0-3fc2-42f7-bd62-a11492f6600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c2b6c0-3fc2-42f7-bd62-a11492f6600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b', 'volume_name': 'volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab943cfe-7099-4f39-b63b-81fbdf9c6e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab943cfe-7099-4f39-b63b-81fbdf9c6e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ed136-99da-4f86-ad9b-eaeac0f602b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b', 'volume_size': 1} Feb 27 02:10:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (7103bca6-86bb-4b34-8394-8ea2afbf09c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7947382c-3679-4e25-a35d-72ba779ae975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7947382c-3679-4e25-a35d-72ba779ae975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707541023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f18d89-3ed1-47e5-b681-549787103243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d7b043-c85e-4394-8291-68b6de0fcf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d7b043-c85e-4394-8291-68b6de0fcf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f205ec-b3b9-47bc-8bcd-6c66ca30a6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f205ec-b3b9-47bc-8bcd-6c66ca30a6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f18d89-3ed1-47e5-b681-549787103243', 'volume_name': 'volume-17f18d89-3ed1-47e5-b681-549787103243', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4501ef8-e666-4e3c-9b9b-b68ac3eb8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4501ef8-e666-4e3c-9b9b-b68ac3eb8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d333a907-bc0f-4aa7-be82-283ce07226fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume 17f18d89-3ed1-47e5-b681-549787103243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f18d89-3ed1-47e5-b681-549787103243', 'volume_size': 1} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (c10f995b-8d63-489a-98ec-8b6f3a7f4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da63a9c7-f862-43c1-992a-5614ea51108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079" returned: 0 in 0.586s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 is being set with open permissions: ugo+rw Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da63a9c7-f862-43c1-992a-5614ea51108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603599439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adaf127-207c-461d-9fef-37999b9a02af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 Feb 27 02:10:15 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23374b73-985a-4443-890a-0cdaff6cf2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23374b73-985a-4443-890a-0cdaff6cf2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7f869f-6e75-4718-a7d0-c1ec0a8a47a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7f869f-6e75-4718-a7d0-c1ec0a8a47a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8adaf127-207c-461d-9fef-37999b9a02af', 'volume_name': 'volume-8adaf127-207c-461d-9fef-37999b9a02af', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fbae8-e88e-4fdc-8f31-fec02670707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58fbae8-e88e-4fdc-8f31-fec02670707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf00ac4-b96f-42e2-b776-4f2c4a6e3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume 8adaf127-207c-461d-9fef-37999b9a02af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8adaf127-207c-461d-9fef-37999b9a02af', 'volume_size': 1} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-62798796-e6e0-4200-a23a-dd05b90d13f8" returned: 0 in 0.604s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-quobyte-62798796-e6e0-4200-a23a-dd05b90d13f8" released by "delete_volume" :: held 1.292s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Created reservations ['6e1a2579-1c23-47bf-bcba-841408dcd0f6', '64f42dae-a4af-4529-9c63-275de4463720', '9a196493-2fea-44b9-8a5b-a7d245e02850', '2d8d9164-143a-4f47-9470-22d3ad5a3431'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:15 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079" returned: 0 in 0.438s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info Feb 27 02:10:15 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Deleted volume successfully. Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4e30e860-847e-456c-ad3f-1b6717739101 tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-62798796-e6e0-4200-a23a-dd05b90d13f8-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:16 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info" returned: 0 in 0.462s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info is being set with open permissions: ugo+rw Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info Feb 27 02:10:16 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Flow 'volume_create_manager' (f15724bf-301d-48d7-b80a-0e78656ebd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b0ff1b-0900-47c9-8345-ff260ae718a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b0ff1b-0900-47c9-8345-ff260ae718a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-838932108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8c1bb9752143dc887a3c82b18dace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:17Z,use_quota=True,user_id='cc5c709770a846abb3cb934316ccb073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97446c0d-2016-42f6-870e-f72b14f26690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97446c0d-2016-42f6-870e-f72b14f26690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b46d8ff-7ff2-4c16-9403-7e4412de81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b46d8ff-7ff2-4c16-9403-7e4412de81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d', 'volume_name': 'volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a614a51-1470-498a-b136-7c0bb787ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a614a51-1470-498a-b136-7c0bb787ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b5f22-688c-4b12-9d23-dd5c73affa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Volume 56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d', 'volume_size': 1} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:16 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.info" returned: 0 in 0.454s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.672s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe-a4de5b8b-6a25-462a-904b-61150c3c89b5" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe-a4de5b8b-6a25-462a-904b-61150c3c89b5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Creating volume a4de5b8b-6a25-462a-904b-61150c3c89b5 from snapshot cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] snapshot: cf995153-bb7b-4312-ac18-ae80b129dffe, volume: a4de5b8b-6a25-462a-904b-61150c3c89b5, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-70c44b99-cc5f-49c2-a87c-7ef33f9fabfa tempest-VolumesSnapshotTestJSON-170796422 None] Create snapshot completed successfully Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ae8787-9a82-4432-8018-44d3cc2c2b97]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:16 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-34b497e2-145c-4e25-ba8d-3ce41187e079-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-34b497e2-145c-4e25-ba8d-3ce41187e079-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-34b497e2-145c-4e25-ba8d-3ce41187e079" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-34b497e2-145c-4e25-ba8d-3ce41187e079" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Deleting offline snapshot 34b497e2-145c-4e25-ba8d-3ce41187e079 of volume 61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] snapshot_file for this snap is: volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c2df16-f0cd-4811-9a18-44ec7efb1869]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.530s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21f13e2-475a-4aad-a961-b5c17d254a06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf5a721-4617-40bf-b349-3e53aaa03d93]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 Feb 27 02:10:17 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:17 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079" returned: 0 in 0.538s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee221e9-7bf1-4f78-b07d-ba303cbf7893]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.519s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 Feb 27 02:10:17 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b Feb 27 02:10:17 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b" returned: 0 in 0.587s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 Feb 27 02:10:18 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079" returned: 0 in 1.712s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079 Feb 27 02:10:20 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5" returned: 0 in 2.336s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92d7db-5a55-4837-b658-33cf453ed750]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:20 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b.34b497e2-145c-4e25-ba8d-3ce41187e079" returned: 0 in 0.484s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-34b497e2-145c-4e25-ba8d-3ce41187e079" released by "_delete_snapshot" :: held 3.404s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" released by "delete_snapshot" :: held 3.416s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['a461c389-e488-4790-8895-2232e49297b4', 'b11ce2b8-f20f-441b-834c-9d9c38f67319', 'e14275fc-28f7-4752-8cce-c3d458871821', '55e18937-97e8-4e68-9b32-f30b8b971d99'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Delete snapshot completed successfully. Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2168c369-e00a-4d57-959a-407278c64169 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-34b497e2-145c-4e25-ba8d-3ce41187e079-delete_snapshot" released by "delete_snapshot" :: held 3.537s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:20 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.633s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:20 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Converted 1024.00 MB image at 438.05 MB/s Feb 27 02:10:20 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 is being set with open permissions: ugo+rw Feb 27 02:10:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 Feb 27 02:10:20 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5" returned: 0 in 0.393s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" released by "_copy_volume_from_snapshot" :: held 4.483s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe-a4de5b8b-6a25-462a-904b-61150c3c89b5" released by "_create_volume_from_snapshot" :: held 4.509s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.542s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.812s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966585699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c858a53f-90b0-456b-9112-56373f76cd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:14Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume c858a53f-90b0-456b-9112-56373f76cd0b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:21 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b 1073741824 Feb 27 02:10:21 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12df830d-bd71-497c-975d-eb5b15386833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4de5b8b-6a25-462a-904b-61150c3c89b5', 'volume_size': 1, 'snapshot_id': 'cf995153-bb7b-4312-ac18-ae80b129dffe'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e51a99-2a04-4fa7-8bb0-f8be32d788ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Volume volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 (a4de5b8b-6a25-462a-904b-61150c3c89b5): created successfully Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e51a99-2a04-4fa7-8bb0-f8be32d788ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Flow 'volume_create_manager' (33be245d-838b-4f2c-810e-4faf2473a33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-898998d2-a789-4657-af80-3b258b49528d tempest-SnapshotDependencyTests-507906655 None] Created volume successfully. Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (76609851-0c6e-4ea7-b92d-4b17f479f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6716a781-f2b3-45c3-a808-4cd08d329917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6716a781-f2b3-45c3-a808-4cd08d329917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311051002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b9458-341b-43f0-8fde-ff15df5234d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:22Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e7ca2-ee8b-4643-bd6d-a24b32f12076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024e7ca2-ee8b-4643-bd6d-a24b32f12076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2e8344-84f9-4215-8a95-528d42f35fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2e8344-84f9-4215-8a95-528d42f35fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976b9458-341b-43f0-8fde-ff15df5234d0', 'volume_name': 'volume-976b9458-341b-43f0-8fde-ff15df5234d0', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba15eb4-8199-4101-b8af-0d175cb6882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba15eb4-8199-4101-b8af-0d175cb6882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536f6cd1-7441-4ff0-a5fe-0247dffde501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Volume 976b9458-341b-43f0-8fde-ff15df5234d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976b9458-341b-43f0-8fde-ff15df5234d0', 'volume_size': 1} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-cf995153-bb7b-4312-ac18-ae80b129dffe-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-cf995153-bb7b-4312-ac18-ae80b129dffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Deleting offline snapshot cf995153-bb7b-4312-ac18-ae80b129dffe of volume b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] snapshot_file for this snap is: volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5f1d3-6405-4c05-a944-eac3db844aa2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b 1073741824" returned: 0 in 0.659s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b Feb 27 02:10:22 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:22 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.548s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b21f13e2-475a-4aad-a961-b5c17d254a06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a672ca-14ec-47a4-8a8a-056f03a5b8df]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b" returned: 0 in 0.562s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.866s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949045849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0762c41-77c8-4f69-adc4-ffff6a90c3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume d0762c41-77c8-4f69-adc4-ffff6a90c3bb {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:22 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd93aa13-8e8e-40c0-b7ba-962518da070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c858a53f-90b0-456b-9112-56373f76cd0b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fa7515-4e0a-4807-810c-5e5fa4e3e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb 1073741824 Feb 27 02:10:22 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-c858a53f-90b0-456b-9112-56373f76cd0b (c858a53f-90b0-456b-9112-56373f76cd0b): created successfully Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fa7515-4e0a-4807-810c-5e5fa4e3e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (06ad0c0e-47a7-4175-b290-fff69729087a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:22 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:22 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ddd17bf8-0cba-4fa1-a87a-98687d5b946e tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:23 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:23 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb 1073741824" returned: 0 in 0.631s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb Feb 27 02:10:23 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.520s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe Feb 27 02:10:23 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" returned: 0 in 0.550s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.827s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695427693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:23 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b 1073741824 Feb 27 02:10:23 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d4b596-64a2-46ec-b30c-29b09e13a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91faef0f-a05d-437d-b2bc-d041567beaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:23 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb (d0762c41-77c8-4f69-adc4-ffff6a90c3bb): created successfully Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91faef0f-a05d-437d-b2bc-d041567beaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (1f8eb851-e49f-4193-b718-2f0f89050bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:23 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2e358afb-ca63-460a-b527-99f35862019d tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:24 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06.cf995153-bb7b-4312-ac18-ae80b129dffe" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-cf995153-bb7b-4312-ac18-ae80b129dffe" released by "_delete_snapshot" :: held 2.218s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" released by "delete_snapshot" :: held 2.233s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Created reservations ['432ff1a6-6b9e-477d-a0c8-d7db37be2432', '65db5f12-3472-4ac6-8cb6-cec2ea910594', '10677f89-5c7e-4ba8-9bc3-eaff5e43d012', 'e9a9e3a2-cbe4-456d-9aec-8086a9f6be02'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:24 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Delete snapshot completed successfully. Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4313860d-018e-4fdc-a440-d992b91fc021 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-cf995153-bb7b-4312-ac18-ae80b129dffe-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:24 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b 1073741824" returned: 0 in 0.604s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b Feb 27 02:10:24 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" returned: 0 in 0.457s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.718s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707541023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f18d89-3ed1-47e5-b681-549787103243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume 17f18d89-3ed1-47e5-b681-549787103243 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:24 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 1073741824 Feb 27 02:10:24 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ed136-99da-4f86-ad9b-eaeac0f602b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5ca18-e495-4fa6-94fb-b792fa7f87f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:24 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b (fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b): created successfully Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5ca18-e495-4fa6-94fb-b792fa7f87f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (cebff75a-e934-4496-85bf-9908e9865e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:24 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3711e3b4-bc2a-45e1-9df0-14888b8d2d25 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-b21f13e2-475a-4aad-a961-b5c17d254a06-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-b21f13e2-475a-4aad-a961-b5c17d254a06-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d121a885-36e8-4620-86c5-c19eb5a7ba94]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:25 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 1073741824" returned: 0 in 0.630s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 Feb 27 02:10:25 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.548s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06 Feb 27 02:10:25 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243" returned: 0 in 0.463s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.615s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603599439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8adaf127-207c-461d-9fef-37999b9a02af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd97d04b47245728ca905f1aa82e889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:15Z,use_quota=True,user_id='8d54f7b5cac74d8eaa93e73581202913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Creating volume 8adaf127-207c-461d-9fef-37999b9a02af {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:26 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d333a907-bc0f-4aa7-be82-283ce07226fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f18d89-3ed1-47e5-b681-549787103243', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:26 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af 1073741824 Feb 27 02:10:26 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fcf85a-c7c8-4c3f-b103-8193e9aa5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-17f18d89-3ed1-47e5-b681-549787103243 (17f18d89-3ed1-47e5-b681-549787103243): created successfully Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fcf85a-c7c8-4c3f-b103-8193e9aa5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (7103bca6-86bb-4b34-8394-8ea2afbf09c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:26 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-041ef273-0972-4b2d-817e-d16d1c370979 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:26 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b21f13e2-475a-4aad-a961-b5c17d254a06" returned: 0 in 0.425s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-b21f13e2-475a-4aad-a961-b5c17d254a06" released by "delete_volume" :: held 1.009s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Created reservations ['d73de99d-8ab2-4b34-bfa2-76a87aa42572', '99390ce6-34f2-48e6-82a1-7f5d92aff512', '89818552-fd48-4ad6-b3b4-8dd52a92cd55', '057f09ab-a74a-4675-bece-63d52e0df3e5'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:26 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af 1073741824" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.424s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:26 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af Feb 27 02:10:26 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Deleted volume successfully. Feb 27 02:10:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-469f5b28-f52e-4ff8-a04c-0d7a45f61e98 tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-b21f13e2-475a-4aad-a961-b5c17d254a06-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:27 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af" returned: 0 in 0.407s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.365s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-838932108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8c1bb9752143dc887a3c82b18dace1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:17Z,use_quota=True,user_id='cc5c709770a846abb3cb934316ccb073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Creating volume 56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:27 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf00ac4-b96f-42e2-b776-4f2c4a6e3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8adaf127-207c-461d-9fef-37999b9a02af', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d 1073741824 Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704e3e95-2199-40a3-a71c-30a1111adfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Volume volume-8adaf127-207c-461d-9fef-37999b9a02af (8adaf127-207c-461d-9fef-37999b9a02af): created successfully Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704e3e95-2199-40a3-a71c-30a1111adfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Flow 'volume_create_manager' (c10f995b-8d63-489a-98ec-8b6f3a7f4a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-da8b3d94-946d-4b9b-bda5-d50bf930d836 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created volume successfully. Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-a4de5b8b-6a25-462a-904b-61150c3c89b5-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-a4de5b8b-6a25-462a-904b-61150c3c89b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afbbf0d-af38-4640-8459-53237c62e503]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-8adaf127-207c-461d-9fef-37999b9a02af-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-8adaf127-207c-461d-9fef-37999b9a02af-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-8adaf127-207c-461d-9fef-37999b9a02af" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-8adaf127-207c-461d-9fef-37999b9a02af" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 Feb 27 02:10:27 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11294d-406f-4a31-994c-9f589dd6a59c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af Feb 27 02:10:27 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d 1073741824" returned: 0 in 0.612s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d Feb 27 02:10:27 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5" returned: 0 in 0.545s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5 Feb 27 02:10:27 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af" returned: 0 in 0.527s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af Feb 27 02:10:28 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" returned: 0 in 0.457s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.296s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311051002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976b9458-341b-43f0-8fde-ff15df5234d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:22Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Creating volume 976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:28 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b5f22-688c-4b12-9d23-dd5c73affa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:28 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 1073741824 Feb 27 02:10:28 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7ef99a-dfd1-467b-8b79-0f957ffb0bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:28 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Volume volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d (56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d): created successfully Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7ef99a-dfd1-467b-8b79-0f957ffb0bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Flow 'volume_create_manager' (f15724bf-301d-48d7-b80a-0e78656ebd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-23f1af3a-0027-439f-a88f-d2e156fa2c63 tempest-VolumesTransfersTest-1488624510 None] Created volume successfully. Feb 27 02:10:28 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a4de5b8b-6a25-462a-904b-61150c3c89b5" returned: 0 in 0.487s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-quobyte-a4de5b8b-6a25-462a-904b-61150c3c89b5" released by "delete_volume" :: held 1.076s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Created reservations ['497cd667-2418-4747-a725-644f68b9107e', '8b317e16-a507-4e0c-9565-c635d9ba70c6', '41052673-fe89-468e-a531-2f2db20df96c', 'bd25b961-3a07-4674-9372-3888d6a3ce88'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:28 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8adaf127-207c-461d-9fef-37999b9a02af" returned: 0 in 0.568s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-8adaf127-207c-461d-9fef-37999b9a02af" released by "delete_volume" :: held 1.135s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['6a8cebcb-343f-452b-98bd-935dc2e9ed25', '118f254f-9e25-4270-b1ec-769925a75eaa', '51ea36de-e9d1-47af-9319-f08e1fa5aa2b', '436c50da-31f7-47c3-af3e-9b746800122b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "cinder-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:28 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "cinder-quobyte-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-quobyte-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a937e-c247-4ca8-80ca-a8010c632a0d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d Feb 27 02:10:28 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 1073741824" returned: 0 in 0.747s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:29 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.496s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Deleted volume successfully. Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6b6cfbb4-e5a6-4d02-9a45-da1f8b1e5bcf tempest-SnapshotDependencyTests-507906655 None] Lock "cinder-a4de5b8b-6a25-462a-904b-61150c3c89b5-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:29 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.555s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-71d3a573-d719-4074-b48d-2e30a27cdcd2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-8adaf127-207c-461d-9fef-37999b9a02af-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:29 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" returned: 0 in 0.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d Feb 27 02:10:29 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.441s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536f6cd1-7441-4ff0-a5fe-0247dffde501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976b9458-341b-43f0-8fde-ff15df5234d0', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e67239-9b84-47b9-ace0-bdf6de27e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:29 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Volume volume-976b9458-341b-43f0-8fde-ff15df5234d0 (976b9458-341b-43f0-8fde-ff15df5234d0): created successfully Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e67239-9b84-47b9-ace0-bdf6de27e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (76609851-0c6e-4ea7-b92d-4b17f479f26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-85c44f06-5e12-484e-a870-dc84bed4568b tempest-VolumesSnapshotTestJSON-170796422 None] Created volume successfully. Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-17f18d89-3ed1-47e5-b681-549787103243-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-17f18d89-3ed1-47e5-b681-549787103243-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-17f18d89-3ed1-47e5-b681-549787103243" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-17f18d89-3ed1-47e5-b681-549787103243" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcae18c4-6af9-47b9-a044-953c87924cb2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 Feb 27 02:10:29 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" returned: 0 in 0.449s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-quobyte-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d" released by "delete_volume" :: held 1.031s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Created reservations ['2c51df7a-146f-4fe3-99c4-d98d0291e247', 'cbd3a228-a6af-4434-b0b5-3237cdd70f2b', '82009c0b-90ba-4574-8526-2d1dc6620684', '1eeddac5-4f15-4613-8943-48b7046bb344'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:29 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243" returned: 0 in 0.685s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243 Feb 27 02:10:30 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.565s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Deleted volume successfully. Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Creating offline snapshot fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 of volume 976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c1076-a483-4815-9687-1f616126a3be]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-017fdef0-1fb8-4ee7-a88b-6e8bcaff853b tempest-VolumesTransfersTest-1067386540 None] Lock "cinder-56cc4665-0fb1-4cd8-a1a4-c9dc85509b6d-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:30 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-17f18d89-3ed1-47e5-b681-549787103243" returned: 0 in 0.488s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-17f18d89-3ed1-47e5-b681-549787103243" released by "delete_volume" :: held 1.198s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['6054f91f-0d07-482f-bb27-e8a4f1566211', '9f230213-39a4-4192-9647-63af63295fc3', 'ce558c33-1283-44f6-ba93-c30862429682', 'fea00518-7029-4869-b816-32aaeaff2bd9'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:31 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.590s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 1G Feb 27 02:10:31 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.551s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:31 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-07c44be3-492c-4d28-ab7a-c3bb8fb98443 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-17f18d89-3ed1-47e5-b681-549787103243-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:31 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 1G" returned: 0 in 0.657s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976b9458-341b-43f0-8fde-ff15df5234d0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976b9458-341b-43f0-8fde-ff15df5234d0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:31 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ffd52-df93-4312-8581-d302f94fc6ef]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b Feb 27 02:10:32 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976b9458-341b-43f0-8fde-ff15df5234d0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.603s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 is being set with open permissions: ugo+rw Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:32 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" returned: 0 in 0.724s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b Feb 27 02:10:32 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.557s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info Feb 27 02:10:33 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" returned: 0 in 0.609s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b" released by "delete_volume" :: held 1.367s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['07fdb09e-c4eb-4a36-bdad-e56b7b76793a', 'fd1f99bf-fa81-421b-bde6-020321f31a03', 'e8f24f24-820e-4060-b281-387742b8142a', 'c6d3cb77-cbb0-4c34-a4f0-550c53872b03'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:33 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info" returned: 0 in 0.655s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:33 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info is being set with open permissions: ugo+rw Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info Feb 27 02:10:33 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:33 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.info" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.623s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:34 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-bbb138e1-ca9c-4fc1-b851-d4aff22fb419 tempest-VolumesSnapshotTestJSON-170796422 None] Create snapshot completed successfully Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-440506da-9ec6-4388-be6b-5ec5a418a090 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-fe9c0a5a-ff00-451a-9ff0-d66c7addcd5b-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-d0762c41-77c8-4f69-adc4-ffff6a90c3bb-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-d0762c41-77c8-4f69-adc4-ffff6a90c3bb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a50e5-0374-4d3e-90a0-3390a87f7dbe]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb Feb 27 02:10:34 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb Feb 27 02:10:34 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:35 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-d0762c41-77c8-4f69-adc4-ffff6a90c3bb" released by "delete_volume" :: held 1.079s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['c717bd06-bd93-4504-8812-806536e63e56', 'f86cfe7a-a417-4411-955c-6e6253e8e4f4', '16b75387-e596-4f42-9e1f-e6d8ec079fb3', 'be335a87-7805-4053-81e8-a637a635e6b8'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (02ec1a3a-3a4a-456c-8da0-e24fdd961eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbb9d38-87a8-4bd7-901a-7197e628a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbb9d38-87a8-4bd7-901a-7197e628a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629337346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b80304c-169c-4994-a731-5c8dbd2d992e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fb8e6886-b6bf-454c-8fcb-b6c4c86a5223,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:37Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882c8321-c387-42ea-88d0-9aed3f8ca6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882c8321-c387-42ea-88d0-9aed3f8ca6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7b8e31-f3f1-4daa-9f48-f36fa56feb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7b8e31-f3f1-4daa-9f48-f36fa56feb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b80304c-169c-4994-a731-5c8dbd2d992e', 'volume_name': 'volume-2b80304c-169c-4994-a731-5c8dbd2d992e', 'volume_size': 2, 'snapshot_id': 'fb8e6886-b6bf-454c-8fcb-b6c4c86a5223'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f5736-db2e-4722-8140-150195225a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4f5736-db2e-4722-8140-150195225a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65f139-3f04-49be-9ff6-97737c14d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Volume 2b80304c-169c-4994-a731-5c8dbd2d992e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b80304c-169c-4994-a731-5c8dbd2d992e', 'volume_size': 2, 'snapshot_id': 'fb8e6886-b6bf-454c-8fcb-b6c4c86a5223'} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-2b80304c-169c-4994-a731-5c8dbd2d992e" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:40 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:40 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-2b80304c-169c-4994-a731-5c8dbd2d992e" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Creating volume 2b80304c-169c-4994-a731-5c8dbd2d992e from snapshot fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] snapshot: fb8e6886-b6bf-454c-8fcb-b6c4c86a5223, volume: 2b80304c-169c-4994-a731-5c8dbd2d992e, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c339591-c391-423b-9527-2231cc108669]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:40 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-c858a53f-90b0-456b-9112-56373f76cd0b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-c858a53f-90b0-456b-9112-56373f76cd0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-c858a53f-90b0-456b-9112-56373f76cd0b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-c858a53f-90b0-456b-9112-56373f76cd0b" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9a96b3-a6b0-4315-b73f-c2ac74ac0150]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b Feb 27 02:10:41 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.661s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:41 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-68b03edf-2d74-4a6a-8e49-b5565f6cb0de tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-d0762c41-77c8-4f69-adc4-ffff6a90c3bb-delete_volume" released by "delete_volume" :: held 6.792s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:41 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.803s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976b9458-341b-43f0-8fde-ff15df5234d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec579403-9baf-4267-a38c-920ac780213b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:41 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b" returned: 0 in 0.795s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b Feb 27 02:10:41 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.714s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e Feb 27 02:10:42 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-c858a53f-90b0-456b-9112-56373f76cd0b" returned: 0 in 0.729s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-c858a53f-90b0-456b-9112-56373f76cd0b" released by "delete_volume" :: held 1.588s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['a1c1b625-ed5a-4f9c-b0c9-766cb5c7652b', '67333200-f37d-4fa0-9c22-4d63403084bd', 'a21ea4d8-6e48-4125-8bf3-5001a8b70ea2', 'd106648e-1625-4d5a-a47c-c00862e00c6b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:42 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-155ce651-a6a6-41f0-8c48-e9d088ca799e-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-155ce651-a6a6-41f0-8c48-e9d088ca799e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "cinder-quobyte-155ce651-a6a6-41f0-8c48-e9d088ca799e" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-155ce651-a6a6-41f0-8c48-e9d088ca799e" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d9686-b872-4f61-865c-21e8a3e7644c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:43 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.048s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1b4d2a4f-dd7b-451c-a29a-bcb0ee99d7ee tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-c858a53f-90b0-456b-9112-56373f76cd0b-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:43 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e Feb 27 02:10:43 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:44 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e" returned: 0 in 2.921s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3442df0-436c-465c-afb4-d49dc7031e07]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:45 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:45 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e" returned: 0 in 1.598s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e Feb 27 02:10:45 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:45 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-155ce651-a6a6-41f0-8c48-e9d088ca799e" returned: 0 in 0.572s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-quobyte-155ce651-a6a6-41f0-8c48-e9d088ca799e" released by "delete_volume" :: held 2.213s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:45 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.711s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0, size 1024.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:45 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Converted 1024.00 MB image at 350.49 MB/s Feb 27 02:10:45 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e is being set with open permissions: ugo+rw Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Created reservations ['87285eeb-dc6f-4cca-b1f5-c2067be96adb', '5e3bae5b-c321-44d4-b288-54d6f45a2267', 'e3e94959-690e-4e65-b421-ef5e96e3c24d', '58141ccf-14d3-4a16-a7a4-d576f09c4b5a'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:45 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e Feb 27 02:10:45 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:45 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e" returned: 0 in 0.443s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" released by "_copy_volume_from_snapshot" :: held 5.672s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-2b80304c-169c-4994-a731-5c8dbd2d992e" released by "_create_volume_from_snapshot" :: held 5.695s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.720s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65f139-3f04-49be-9ff6-97737c14d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b80304c-169c-4994-a731-5c8dbd2d992e', 'volume_size': 2, 'snapshot_id': 'fb8e6886-b6bf-454c-8fcb-b6c4c86a5223'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7ee63e-e152-40a9-a57e-779cc988b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Volume volume-2b80304c-169c-4994-a731-5c8dbd2d992e (2b80304c-169c-4994-a731-5c8dbd2d992e): created successfully Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7ee63e-e152-40a9-a57e-779cc988b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (02ec1a3a-3a4a-456c-8da0-e24fdd961eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-356dd298-4a93-45a2-bac9-e10eebef275a tempest-VolumesSnapshotTestJSON-170796422 None] Created volume successfully. Feb 27 02:10:46 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.521s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Deleted volume successfully. Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-314e840f-d948-4f32-94f3-dee531b3b6c2 tempest-CreateVolumesFromSourceVolumeTest-1991079001 None] Lock "cinder-155ce651-a6a6-41f0-8c48-e9d088ca799e-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-2b80304c-169c-4994-a731-5c8dbd2d992e-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-2b80304c-169c-4994-a731-5c8dbd2d992e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:47 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[322437fd-e52a-478f-bdf1-328a05f3b4a4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e Feb 27 02:10:47 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e" returned: 0 in 0.569s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e Feb 27 02:10:47 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-2b80304c-169c-4994-a731-5c8dbd2d992e" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-2b80304c-169c-4994-a731-5c8dbd2d992e" released by "delete_volume" :: held 1.059s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['e6a8a813-7fef-45bc-939c-443c651d3978', '96eafdec-d772-4a69-9593-5173f8e13e46', 'b253f1bb-32ba-4c3b-a356-40c159a85b9d', '98e0ac0c-0f31-4250-a7bd-af1ec58db274'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:48 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:48 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Flow 'volume_create_manager' (cb77f305-f558-4081-a8db-38bc0b05e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d7934-3a78-4bf0-9fbd-05704732037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d7934-3a78-4bf0-9fbd-05704732037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5681462-7d27-4313-b46f-cb5ca64f1951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e7a4c043645919e83199f7046fb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:49Z,use_quota=True,user_id='2956c680fbf84ff989b28b26793e804e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:48 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2facaa5b-ab1e-488e-8209-bdff1b08b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2facaa5b-ab1e-488e-8209-bdff1b08b357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eaf46f-fa4b-4607-afd1-c3951e034676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eaf46f-fa4b-4607-afd1-c3951e034676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5681462-7d27-4313-b46f-cb5ca64f1951', 'volume_name': 'volume-f5681462-7d27-4313-b46f-cb5ca64f1951', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c0b86-5944-4c0b-a478-def287dae839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c0b86-5944-4c0b-a478-def287dae839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439dbcd6-05a9-4583-a942-cdf16121beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:48 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Volume f5681462-7d27-4313-b46f-cb5ca64f1951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5681462-7d27-4313-b46f-cb5ca64f1951', 'volume_size': 1} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5681462-7d27-4313-b46f-cb5ca64f1951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e7a4c043645919e83199f7046fb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:49Z,use_quota=True,user_id='2956c680fbf84ff989b28b26793e804e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Creating volume f5681462-7d27-4313-b46f-cb5ca64f1951 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:48 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.576s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:48 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Deleted volume successfully. Feb 27 02:10:48 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 1073741824 Feb 27 02:10:48 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-268ed686-a6fa-4458-bf7c-a27d9a27bbb7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-2b80304c-169c-4994-a731-5c8dbd2d992e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Deleting offline snapshot fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 of volume 976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] snapshot_file for this snap is: volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[33983e8b-c0d1-4538-b30e-cd314ac4ab3f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:49 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 1073741824" returned: 0 in 0.647s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 Feb 27 02:10:49 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.593s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976b9458-341b-43f0-8fde-ff15df5234d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a1630-5eef-40d7-95eb-8216316c541a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:49 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951" returned: 0 in 0.520s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439dbcd6-05a9-4583-a942-cdf16121beab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5681462-7d27-4313-b46f-cb5ca64f1951', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee2998a-8e93-4074-93eb-2719ba6ba688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:49 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Volume volume-f5681462-7d27-4313-b46f-cb5ca64f1951 (f5681462-7d27-4313-b46f-cb5ca64f1951): created successfully Feb 27 02:10:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee2998a-8e93-4074-93eb-2719ba6ba688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Flow 'volume_create_manager' (cb77f305-f558-4081-a8db-38bc0b05e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-025512d3-2f26-418a-be4e-a7175e3f1b10 tempest-CinderUnicodeTest-369344074 None] Created volume successfully. Feb 27 02:10:50 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:50 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223 Feb 27 02:10:50 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0.fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" returned: 0 in 0.543s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223" released by "_delete_snapshot" :: held 2.323s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" released by "delete_snapshot" :: held 2.343s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Flow 'volume_create_manager' (937a02b8-9c4e-4e32-9a1c-f4d2aba6569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b1b95e-2dec-4e91-a532-611219080991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b1b95e-2dec-4e91-a532-611219080991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-604876673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5813dcca-461a-448e-b0e0-2d30d2d68060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e7a4c043645919e83199f7046fb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:51Z,use_quota=True,user_id='2956c680fbf84ff989b28b26793e804e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e2f3e5-3fdf-4311-9ea6-09af56aa71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e2f3e5-3fdf-4311-9ea6-09af56aa71e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9c8d3c-2ac1-41f1-8ff0-f178c6f99bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9c8d3c-2ac1-41f1-8ff0-f178c6f99bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5813dcca-461a-448e-b0e0-2d30d2d68060', 'volume_name': 'volume-5813dcca-461a-448e-b0e0-2d30d2d68060', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d04c243-f9a5-455a-b84b-17c8c4891557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d04c243-f9a5-455a-b84b-17c8c4891557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5cab08-cc6c-410a-9695-2252cfadf1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Volume 5813dcca-461a-448e-b0e0-2d30d2d68060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5813dcca-461a-448e-b0e0-2d30d2d68060', 'volume_size': 1} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-604876673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5813dcca-461a-448e-b0e0-2d30d2d68060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e7a4c043645919e83199f7046fb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:51Z,use_quota=True,user_id='2956c680fbf84ff989b28b26793e804e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Creating volume 5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:51 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:51 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 1073741824 Feb 27 02:10:51 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['31ddf880-1c91-49fe-be1c-8535a804b7ba', 'b6f31f14-8036-4621-9d37-0791bf85b2d0', '58aa3cdd-8ad8-4e23-9b17-0dcb0a2d71b7', '230f1ee8-1553-4ee7-88a5-e2688642f8e5'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Delete snapshot completed successfully. Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fac1101a-301c-490e-aa45-311b07ff1cd7 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-fb8e6886-b6bf-454c-8fcb-b6c4c86a5223-delete_snapshot" released by "delete_snapshot" :: held 2.542s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Flow 'volume_create_manager' (3f40e9ab-e348-4dab-ab7e-6f6dd3c1f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ac879d-7bcf-4087-a551-180ca6b0aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ac879d-7bcf-4087-a551-180ca6b0aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-825843828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8644373c-d321-457f-b983-6c4da01faefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb98e5f3795246a0b0aadcec91ddeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:52Z,use_quota=True,user_id='a1d71612986747a0bb2a73df4924b5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e30f3a-aa6a-4e94-8677-2d018b20f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e30f3a-aa6a-4e94-8677-2d018b20f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce87095-b293-4b34-9ebc-49b1344f727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce87095-b293-4b34-9ebc-49b1344f727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8644373c-d321-457f-b983-6c4da01faefd', 'volume_name': 'volume-8644373c-d321-457f-b983-6c4da01faefd', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de4663a-8e2e-4b35-9980-8af76b49fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de4663a-8e2e-4b35-9980-8af76b49fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48c53e3-12ad-4020-84ed-e5482b6df906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Volume 8644373c-d321-457f-b983-6c4da01faefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8644373c-d321-457f-b983-6c4da01faefd', 'volume_size': 1} Feb 27 02:10:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:52 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 1073741824" returned: 0 in 0.526s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 Feb 27 02:10:52 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-976b9458-341b-43f0-8fde-ff15df5234d0-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-976b9458-341b-43f0-8fde-ff15df5234d0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff28cdc-690e-4564-998b-6bc2486aa8a8]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:52 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060" returned: 0 in 0.449s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-825843828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8644373c-d321-457f-b983-6c4da01faefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb98e5f3795246a0b0aadcec91ddeb1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:52Z,use_quota=True,user_id='a1d71612986747a0bb2a73df4924b5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Creating volume 8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:52 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5cab08-cc6c-410a-9695-2252cfadf1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5813dcca-461a-448e-b0e0-2d30d2d68060', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:52 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd 1073741824 Feb 27 02:10:52 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1d7d47-196f-4872-a051-68e50662a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Volume volume-5813dcca-461a-448e-b0e0-2d30d2d68060 (5813dcca-461a-448e-b0e0-2d30d2d68060): created successfully Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1d7d47-196f-4872-a051-68e50662a361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Flow 'volume_create_manager' (937a02b8-9c4e-4e32-9a1c-f4d2aba6569a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-568c9b20-835e-42e5-a06d-939a4c0c0ec7 tempest-CinderUnicodeTest-369344074 None] Created volume successfully. Feb 27 02:10:52 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.484s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0 Feb 27 02:10:52 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd 1073741824" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:53 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:10:53 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-976b9458-341b-43f0-8fde-ff15df5234d0" returned: 0 in 0.432s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-976b9458-341b-43f0-8fde-ff15df5234d0" released by "delete_volume" :: held 0.954s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['3b13fcb9-f583-4cf8-9984-d614842cc76b', 'bb3d6e7d-6a2c-4d53-b1b6-63ffc96d9a66', 'c4308d8f-98b0-4e5b-a24d-2523bc15297f', '60504db1-8c5b-43be-a46a-20fe5809b37f'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:53 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:10:53 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.477s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48c53e3-12ad-4020-84ed-e5482b6df906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8644373c-d321-457f-b983-6c4da01faefd', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e26f289-6e9e-4fc4-8fb1-d93943b259b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Volume volume-8644373c-d321-457f-b983-6c4da01faefd (8644373c-d321-457f-b983-6c4da01faefd): created successfully Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e26f289-6e9e-4fc4-8fb1-d93943b259b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Flow 'volume_create_manager' (3f40e9ab-e348-4dab-ab7e-6f6dd3c1f810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-51f1a303-9479-44bb-ba7f-38380cf923df tempest-VolumesActionsTest-716777048 None] Created volume successfully. Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (ae37e61f-4b85-445a-96a7-343999f752fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ee9b0-6b96-4d2b-8052-726f6f67c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ee9b0-6b96-4d2b-8052-726f6f67c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774578847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84bf387-53ef-4005-9e24-92730f23a199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:54Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4b40ea-c525-40f4-9b6f-81109641b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4b40ea-c525-40f4-9b6f-81109641b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d42f8c0-638d-4849-9748-249ec9a1f874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d42f8c0-638d-4849-9748-249ec9a1f874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84bf387-53ef-4005-9e24-92730f23a199', 'volume_name': 'volume-f84bf387-53ef-4005-9e24-92730f23a199', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06be908b-1e84-4977-9598-f942e5a22e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06be908b-1e84-4977-9598-f942e5a22e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d36390-1980-472f-af9d-0f4851174ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Volume f84bf387-53ef-4005-9e24-92730f23a199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84bf387-53ef-4005-9e24-92730f23a199', 'volume_size': 1} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774578847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84bf387-53ef-4005-9e24-92730f23a199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:54Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Creating volume f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:53 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:53 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 1073741824 Feb 27 02:10:53 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.491s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Deleted volume successfully. Feb 27 02:10:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-edb07fb5-2990-42c8-a8f8-0f1baa1071b0 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-976b9458-341b-43f0-8fde-ff15df5234d0-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:54 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 1073741824" returned: 0 in 0.592s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:10:54 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:54 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.463s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d36390-1980-472f-af9d-0f4851174ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84bf387-53ef-4005-9e24-92730f23a199', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e6d14-a721-4923-918b-07e5327ebd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Creating offline snapshot e15d0a14-de8d-402e-a8d1-39b587ceda25 of volume 5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Volume volume-f84bf387-53ef-4005-9e24-92730f23a199 (f84bf387-53ef-4005-9e24-92730f23a199): created successfully Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e6d14-a721-4923-918b-07e5327ebd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (ae37e61f-4b85-445a-96a7-343999f752fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f33f6-84b9-4b44-92c8-1c9092b5ef4c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-0fac6c6d-bbbb-4e74-90cb-7375e4625c50 tempest-VolumesSnapshotTestJSON-170796422 None] Created volume successfully. Feb 27 02:10:55 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 Feb 27 02:10:55 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060" returned: 0 in 0.497s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:55 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 1G Feb 27 02:10:55 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:56 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 1G" returned: 0 in 0.542s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5813dcca-461a-448e-b0e0-2d30d2d68060 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:56 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5813dcca-461a-448e-b0e0-2d30d2d68060 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 Feb 27 02:10:56 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=209,cinder:SELECT=150,cinder:INSERT=49,cinder:DELETE=26 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=163,cinder:UPDATE=213,cinder:INSERT=50,cinder:DELETE=12 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:56 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5813dcca-461a-448e-b0e0-2d30d2d68060 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25" returned: 0 in 0.491s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:56 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 is being set with open permissions: ugo+rw Feb 27 02:10:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:56 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 Feb 27 02:10:56 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25" returned: 0 in 0.451s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info Feb 27 02:10:57 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info" returned: 0 in 0.464s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info is being set with open permissions: ugo+rw Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info Feb 27 02:10:57 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.info" returned: 0 in 0.392s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.807s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Creating offline snapshot d8553269-f08e-48b4-a077-3940ffad040b of volume f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-35a9c80a-5605-4d9e-98b1-821bb6d1bfe2 tempest-CinderUnicodeTest-369344074 None] Create snapshot completed successfully Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2507c2-5691-4560-aa8d-7a7d7ffd48ac]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:10:58 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-e15d0a14-de8d-402e-a8d1-39b587ceda25-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-e15d0a14-de8d-402e-a8d1-39b587ceda25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-quobyte-e15d0a14-de8d-402e-a8d1-39b587ceda25" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-e15d0a14-de8d-402e-a8d1-39b587ceda25" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Deleting offline snapshot e15d0a14-de8d-402e-a8d1-39b587ceda25 of volume 5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] snapshot_file for this snap is: volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21ec34-6262-4911-8136-54dc95fa5ff5]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 Feb 27 02:10:58 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b 1G Feb 27 02:10:58 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25" returned: 0 in 0.494s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5813dcca-461a-448e-b0e0-2d30d2d68060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c903f024-45e1-434a-bdc3-0b96a915c704]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 Feb 27 02:10:58 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b 1G" returned: 0 in 0.497s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84bf387-53ef-4005-9e24-92730f23a199 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84bf387-53ef-4005-9e24-92730f23a199 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:10:59 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060" returned: 0 in 0.564s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 Feb 27 02:10:59 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84bf387-53ef-4005-9e24-92730f23a199 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.620s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b is being set with open permissions: ugo+rw Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:10:59 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25" returned: 0 in 0.567s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25 Feb 27 02:10:59 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.566s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info Feb 27 02:11:00 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060.e15d0a14-de8d-402e-a8d1-39b587ceda25" returned: 0 in 0.560s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-e15d0a14-de8d-402e-a8d1-39b587ceda25" released by "_delete_snapshot" :: held 2.253s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" released by "delete_snapshot" :: held 2.267s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Created reservations ['a02317df-0d62-4214-9834-3f8be05d457f', '02f39359-504b-48a9-890e-b371e7ae1dd8', '8978464e-7704-4f9d-92c8-25eb8e4f5447', 'bcb3b24c-004d-476c-9a2c-3939fd2d42cb'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:00 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Delete snapshot completed successfully. Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7e0d64f8-2ef0-41e2-9c70-68ee145d160f tempest-CinderUnicodeTest-369344074 None] Lock "cinder-e15d0a14-de8d-402e-a8d1-39b587ceda25-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:00 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info" returned: 0 in 0.534s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info is being set with open permissions: ugo+rw Feb 27 02:11:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info Feb 27 02:11:00 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-5813dcca-461a-448e-b0e0-2d30d2d68060-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "cinder-5813dcca-461a-448e-b0e0-2d30d2d68060-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:01 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.info" returned: 0 in 0.514s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.393s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:01 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d229f3bf-d156-4e25-9186-48130612021a tempest-VolumesSnapshotTestJSON-170796422 None] Create snapshot completed successfully Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1082e130-554c-4b0a-8214-be16e34c4838]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 Feb 27 02:11:01 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060" returned: 0 in 0.518s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060 Feb 27 02:11:01 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:02 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5813dcca-461a-448e-b0e0-2d30d2d68060" returned: 0 in 0.403s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-5813dcca-461a-448e-b0e0-2d30d2d68060" released by "delete_volume" :: held 0.961s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Created reservations ['9259dae7-2f93-424a-a74f-9a0ce30abe40', '7d755f66-def7-4dfb-ade3-e52b516557d6', '73e6ac52-602d-4058-967c-d98fb839b474', '73cbd401-0686-49b5-9578-9f7f7926f5da'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:02 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:02 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (d441d10f-7ee7-4b3c-b0a6-dad0807e85cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401e03c5-e655-434b-a0bd-00120bb5fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401e03c5-e655-434b-a0bd-00120bb5fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1992045248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acfc0461a2814eacb75a0662a80a11f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8553269-f08e-48b4-a077-3940ffad040b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:03Z,use_quota=True,user_id='0543cb5b375a48b0a68d078812635fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c568ecd-de93-4eb4-afc4-f5cb63422c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c568ecd-de93-4eb4-afc4-f5cb63422c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d893b78-3fe1-438b-899a-c1be17bed884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d893b78-3fe1-438b-899a-c1be17bed884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3', 'volume_name': 'volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3', 'volume_size': 1, 'snapshot_id': 'd8553269-f08e-48b4-a077-3940ffad040b'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e286b0-1050-4a24-8f77-89433a480c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e286b0-1050-4a24-8f77-89433a480c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a60342-d369-4cc7-970b-9ce3121130f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:02 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Volume 8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3', 'volume_size': 1, 'snapshot_id': 'd8553269-f08e-48b4-a077-3940ffad040b'} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Creating volume 8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 from snapshot d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] snapshot: d8553269-f08e-48b4-a077-3940ffad040b, volume: 8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0371e4-735c-49d5-a36c-41f5684b0a58]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:02 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.479s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:02 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Deleted volume successfully. Feb 27 02:11:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b3d335f5-f26b-4b6b-8e94-37ba219c3cd0 tempest-CinderUnicodeTest-369344074 None] Lock "cinder-5813dcca-461a-448e-b0e0-2d30d2d68060-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:02 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:11:02 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.535s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84bf387-53ef-4005-9e24-92730f23a199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15b943-8268-4c7e-8548-6cbf3c36f2a4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-f5681462-7d27-4313-b46f-cb5ca64f1951-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "cinder-f5681462-7d27-4313-b46f-cb5ca64f1951-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Acquiring lock "cinder-quobyte-f5681462-7d27-4313-b46f-cb5ca64f1951" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-f5681462-7d27-4313-b46f-cb5ca64f1951" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cb88b4-30ba-4887-8eef-a6a5c2816530]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:11:03 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 Feb 27 02:11:03 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.550s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 Feb 27 02:11:03 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951 Feb 27 02:11:04 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f5681462-7d27-4313-b46f-cb5ca64f1951" returned: 0 in 0.601s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "cinder-quobyte-f5681462-7d27-4313-b46f-cb5ca64f1951" released by "delete_volume" :: held 1.176s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:04 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Created reservations ['b2307e4f-0dbf-41db-acd9-64a7d3cff0e6', '6b7e2195-46a4-4799-9d98-9ff5887d873f', '6f9e8c52-d288-48a6-80bb-2b0180e05a86', 'df987aea-d384-4b67-9e48-989030a7044b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:05 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.739s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Deleted volume successfully. Feb 27 02:11:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-889ab504-0a56-4dd5-ad5c-229cbd62a29a tempest-CinderUnicodeTest-369344074 None] Lock "cinder-f5681462-7d27-4313-b46f-cb5ca64f1951-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:06 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" returned: 0 in 2.393s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5651e7e0-bbc4-448b-beee-0c4b9d4608a8]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:11:06 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.816s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:07 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Converted 1024.00 MB image at 427.73 MB/s Feb 27 02:11:07 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 is being set with open permissions: ugo+rw Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 Feb 27 02:11:07 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" returned: 0 in 0.522s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" released by "_copy_volume_from_snapshot" :: held 4.887s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" released by "_create_volume_from_snapshot" :: held 4.913s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.924s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a60342-d369-4cc7-970b-9ce3121130f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3', 'volume_size': 1, 'snapshot_id': 'd8553269-f08e-48b4-a077-3940ffad040b'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901df4cc-93f0-40ac-ae7f-1448f73ef5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Volume volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 (8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3): created successfully Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901df4cc-93f0-40ac-ae7f-1448f73ef5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Flow 'volume_create_manager' (d441d10f-7ee7-4b3c-b0a6-dad0807e85cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b42d8a6b-2ad9-4f09-9aec-26cc4785e65a tempest-VolumesSnapshotTestJSON-170796422 None] Created volume successfully. Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f601ca75-3d67-47ea-ad75-728865514fe4 tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" by "attach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f601ca75-3d67-47ea-ad75-728865514fe4 tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" acquired by "attach_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f601ca75-3d67-47ea-ad75-728865514fe4 tempest-VolumesActionsTest-716777048 None] Attaching volume 8644373c-d321-457f-b983-6c4da01faefd to instance 77792f3d-3443-4f29-883f-31528a2a8f4e at mountpoint /dev/vdb on host None. Feb 27 02:11:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f601ca75-3d67-47ea-ad75-728865514fe4 tempest-VolumesActionsTest-716777048 None] Attach volume completed successfully. Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f601ca75-3d67-47ea-ad75-728865514fe4 tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" released by "attach_volume" :: held 0.086s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[07db2f98-e9f0-4d03-af18-5f431499f46d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 Feb 27 02:11:08 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3ad70cd4-e22a-4cc8-8a9b-dd2078e7029a tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" by "detach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3ad70cd4-e22a-4cc8-8a9b-dd2078e7029a tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3ad70cd4-e22a-4cc8-8a9b-dd2078e7029a tempest-VolumesActionsTest-716777048 None] Detaching volume 8644373c-d321-457f-b983-6c4da01faefd from instance 77792f3d-3443-4f29-883f-31528a2a8f4e. Feb 27 02:11:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3ad70cd4-e22a-4cc8-8a9b-dd2078e7029a tempest-VolumesActionsTest-716777048 None] Detach volume completed successfully. Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3ad70cd4-e22a-4cc8-8a9b-dd2078e7029a tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" returned: 0 in 0.529s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3 Feb 27 02:11:08 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" returned: 0 in 0.385s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3" released by "delete_volume" :: held 0.958s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['08aadf1a-86c0-442d-9bbd-1f803651a8bb', '1fe07264-5a5f-4bf6-83bd-f2df28bea95d', '25e512b9-92a3-4fc2-8b5f-3b6e0dbc220c', '3943f6ed-8b37-4ef1-9186-62c388d0ccc7'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:09 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.416s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:09 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Deleted volume successfully. Feb 27 02:11:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3f5f81d5-8bb9-4642-99ec-4f9616ec90a9 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-8bd78df9-1e9e-4b5d-bb78-34ddde1d6ac3-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-d8553269-f08e-48b4-a077-3940ffad040b-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-d8553269-f08e-48b4-a077-3940ffad040b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Deleting offline snapshot d8553269-f08e-48b4-a077-3940ffad040b of volume f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] snapshot_file for this snap is: volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b1102-d92a-4c63-803e-e51a2fcae6a6]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:11:10 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84bf387-53ef-4005-9e24-92730f23a199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47f061-25dd-43ed-808f-2bd5f4c1dfbe]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:11:11 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.484s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:11:11 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.531s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b Feb 27 02:11:12 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199.d8553269-f08e-48b4-a077-3940ffad040b" returned: 0 in 0.421s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-d8553269-f08e-48b4-a077-3940ffad040b" released by "_delete_snapshot" :: held 2.129s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" released by "delete_snapshot" :: held 2.157s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['28aafd0f-8674-428a-ae59-6b65d8b68bac', 'c1c305d0-212f-43b0-809e-95632d89fc52', '8334e289-a550-4426-98c1-db7402460ed3', 'a706fa28-16bd-47e4-b485-91a477f8baed'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Delete snapshot completed successfully. Feb 27 02:11:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c06882a0-58df-418b-a870-d2df13457e8a tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-d8553269-f08e-48b4-a077-3940ffad040b-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:13 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-f84bf387-53ef-4005-9e24-92730f23a199-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-f84bf387-53ef-4005-9e24-92730f23a199-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b5086-f11a-43ee-a58c-aeb7744174e1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:11:13 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.525s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:14 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.569s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199 Feb 27 02:11:14 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f84bf387-53ef-4005-9e24-92730f23a199" returned: 0 in 0.414s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-f84bf387-53ef-4005-9e24-92730f23a199" released by "delete_volume" :: held 1.027s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['049cea30-aff0-453d-9fea-702d943d1f8e', '832171b2-b18b-4785-84d8-27c891aeb0b6', '463613b4-9c10-4a11-bed1-287f0507c2b8', '90159303-1254-4f7b-876e-359569174708'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:14 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.411s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Deleted volume successfully. Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-2c41093a-542c-4782-ad4f-d1bb84db4778 tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-f84bf387-53ef-4005-9e24-92730f23a199-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-61e96173-f709-4b16-bfe2-a4bb954d8b2b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-61e96173-f709-4b16-bfe2-a4bb954d8b2b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4e48f-8655-47e3-b895-23fcbf7a4674]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b Feb 27 02:11:16 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b Feb 27 02:11:16 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-61e96173-f709-4b16-bfe2-a4bb954d8b2b" returned: 0 in 0.470s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-quobyte-61e96173-f709-4b16-bfe2-a4bb954d8b2b" released by "delete_volume" :: held 1.047s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Created reservations ['e5764194-44e2-45af-9435-89658dc48990', 'cb5c426b-2109-4d37-a953-d0ccc277ca8b', '5be993f2-ec3d-4c9a-80a8-ab4aa3b5384d', 'b438492c-ae18-4f9b-962c-b07abde30209'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:17 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:11:17 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Deleted volume successfully. Feb 27 02:11:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d5c0028c-930e-4ca1-8ff2-72ec5d23f88d tempest-VolumesSnapshotTestJSON-170796422 None] Lock "cinder-61e96173-f709-4b16-bfe2-a4bb954d8b2b-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:27 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=55,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=4 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:27 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=47,cinder:DELETE=4,cinder:UPDATE=69,cinder:INSERT=19 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4ec8053d-77d8-4ae5-933a-3ffa808773ee tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" by "attach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4ec8053d-77d8-4ae5-933a-3ffa808773ee tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" acquired by "attach_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4ec8053d-77d8-4ae5-933a-3ffa808773ee tempest-VolumesActionsTest-716777048 None] Attaching volume 8644373c-d321-457f-b983-6c4da01faefd to instance 6fab37f5-4cdc-457f-8e52-da091d5509e1 at mountpoint /dev/vdb on host None. Feb 27 02:11:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4ec8053d-77d8-4ae5-933a-3ffa808773ee tempest-VolumesActionsTest-716777048 None] Attach volume completed successfully. Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4ec8053d-77d8-4ae5-933a-3ffa808773ee tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd" released by "attach_volume" :: held 0.073s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a76268d7-4d8d-45f9-be87-a5a22d9deaf5 tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" by "detach_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a76268d7-4d8d-45f9-be87-a5a22d9deaf5 tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a76268d7-4d8d-45f9-be87-a5a22d9deaf5 tempest-VolumesActionsTest-716777048 None] Detaching volume 8644373c-d321-457f-b983-6c4da01faefd from instance 6fab37f5-4cdc-457f-8e52-da091d5509e1. Feb 27 02:11:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a76268d7-4d8d-45f9-be87-a5a22d9deaf5 tempest-VolumesActionsTest-716777048 None] Detach volume completed successfully. Feb 27 02:11:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a76268d7-4d8d-45f9-be87-a5a22d9deaf5 tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f5f24-4b2c-490a-8fbc-08889fb372bb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:39 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.501s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa3e22-a78e-4ca8-a042-a179d5b34284]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:40 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.474s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.fd9c0107-fdb7-4360-b718-c871165043c96ejmhkos.img {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.fd9c0107-fdb7-4360-b718-c871165043c96ejmhkos.img Feb 27 02:11:40 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:42 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.fd9c0107-fdb7-4360-b718-c871165043c96ejmhkos.img" returned: 0 in 1.873s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc029dd-c3a1-4cb9-9dfa-d7ea3a3225d3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:42 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.597s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.fd9c0107-fdb7-4360-b718-c871165043c96ejmhkos.img {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:43 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Converted 1024.00 MB image at 546.60 MB/s Feb 27 02:11:43 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] fd9c0107-fdb7-4360-b718-c871165043c9 was raw, no need to convert to raw {{(pid=83211) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 02:11:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=5 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=1 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.953s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Uploaded volume to glance image-id: fd9c0107-fdb7-4360-b718-c871165043c9. {{(pid=83211) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:11:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8cebac02-d6f6-44cc-ac87-9a931eb876b9 tempest-VolumesActionsTest-716777048 None] Copy volume to image completed successfully. Feb 27 02:11:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cbde95-02d0-4549-862b-7c49ddc5008b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:54 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.474s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c228d60a-8faf-4ad5-9f4f-b020be03ccad]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:55 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img Feb 27 02:11:55 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img" returned: 0 in 2.079s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcca295-927e-4132-b265-8a13a458f754]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:11:57 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.597s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:58 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Converted 1024.00 MB image at 492.09 MB/s Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] 9eabe775-884d-4395-aa7a-af3131ea04be was raw, converting to qcow2 {{(pid=83211) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c938e-8fe9-4232-9134-474d9b0bbb7b]: (4, 'raw') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img Feb 27 02:11:58 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img" returned: 0 in 0.457s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img Feb 27 02:11:58 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img" returned: 1 in 0.462s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img' failed. Not Retrying. {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img /opt/stack/data/cinder/conversion/vol_upload__khld3qo {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img /opt/stack/data/cinder/conversion/vol_upload__khld3qo Feb 27 02:11:59 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img /opt/stack/data/cinder/conversion/vol_upload__khld3qo" returned: 0 in 0.467s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Image conversion details: src /opt/stack/data/cinder/conversion/8644373c-d321-457f-b983-6c4da01faefd.temp_image.9eabe775-884d-4395-aa7a-af3131ea04bev2zqenpe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__khld3qo {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:59 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeecf9ed-b82b-4154-b347-0002640d4429]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__khld3qo {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__khld3qo Feb 27 02:11:59 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__khld3qo" returned: 0 in 0.450s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.376s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:00 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Uploaded volume to glance image-id: 9eabe775-884d-4395-aa7a-af3131ea04be. {{(pid=83211) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:12:00 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-57788703-90d0-43c3-a049-d2e1af63dcf6 tempest-VolumesActionsTest-716777048 None] Copy volume to image completed successfully. Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Acquiring lock "cinder-quobyte-8644373c-d321-457f-b983-6c4da01faefd" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "cinder-quobyte-8644373c-d321-457f-b983-6c4da01faefd" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[caca5691-99f6-4f91-abcd-250ffb285976]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:12:02 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.486s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd Feb 27 02:12:02 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8644373c-d321-457f-b983-6c4da01faefd" returned: 0 in 0.408s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "cinder-quobyte-8644373c-d321-457f-b983-6c4da01faefd" released by "delete_volume" :: held 0.922s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Created reservations ['ad117546-ae1c-4d5e-b4aa-612df48c5674', '78404d36-fd0e-4e41-84f8-e4f6035938c2', '789d6069-9bb6-40c6-a25e-b9abd9522390', '7b40513a-c2c1-4901-a904-3760c6a7e9ce'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:03 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Deleted volume successfully. Feb 27 02:12:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d68f192b-17f3-4e15-91fc-c0e31a7d04eb tempest-VolumesActionsTest-716777048 None] Lock "cinder-8644373c-d321-457f-b983-6c4da01faefd-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Flow 'volume_create_manager' (f4d9d25f-5623-43f9-8603-cd46b86b6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4dba30-4865-464b-95a9-a76c2b9154c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4dba30-4865-464b-95a9-a76c2b9154c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1672988266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ab480-1e3a-4af5-9795-b4c071eac727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99d8a29f24d4cc8986079398c05775f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='387fe759bc8e4917b8cf2a27ce986cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658933a7-1016-4d63-b6e4-0111b51d4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658933a7-1016-4d63-b6e4-0111b51d4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13723139-ff70-4170-a247-e31835100253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13723139-ff70-4170-a247-e31835100253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8ab480-1e3a-4af5-9795-b4c071eac727', 'volume_name': 'volume-5b8ab480-1e3a-4af5-9795-b4c071eac727', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db3cc5-6857-4a0e-941e-751191536700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db3cc5-6857-4a0e-941e-751191536700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a630b7-42f1-4b7e-8037-e8e9c3ed6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Volume 5b8ab480-1e3a-4af5-9795-b4c071eac727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8ab480-1e3a-4af5-9795-b4c071eac727', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1672988266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8ab480-1e3a-4af5-9795-b4c071eac727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99d8a29f24d4cc8986079398c05775f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='387fe759bc8e4917b8cf2a27ce986cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Creating volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:07 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 1073741824 Feb 27 02:12:07 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 1073741824" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 Feb 27 02:12:07 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:08 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727" returned: 0 in 0.435s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a630b7-42f1-4b7e-8037-e8e9c3ed6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8ab480-1e3a-4af5-9795-b4c071eac727', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b1ebd-b467-48c0-97b2-69659191dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Volume volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 (5b8ab480-1e3a-4af5-9795-b4c071eac727): created successfully Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b1ebd-b467-48c0-97b2-69659191dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Flow 'volume_create_manager' (f4d9d25f-5623-43f9-8603-cd46b86b6cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f41e95d2-d75a-47bc-860c-38bc4f53b734 tempest-VolumesSnapshotListTestJSON-897081312 None] Created volume successfully. Feb 27 02:12:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Creating offline snapshot 9074daf5-2c95-42d6-8f6c-3541a4e51b9f of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:09 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[75668320-365b-4e15-9f4d-6ee8a15bddbb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:09 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 Feb 27 02:12:09 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727" returned: 0 in 0.506s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:10 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f 1G Feb 27 02:12:10 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f 1G" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:10 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:10 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:10 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.434s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f is being set with open permissions: ugo+rw Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:11 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.407s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info Feb 27 02:12:11 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info" returned: 0 in 0.432s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info is being set with open permissions: ugo+rw Feb 27 02:12:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info Feb 27 02:12:11 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.info" returned: 0 in 0.409s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6d52c5ff-9bfa-44c3-ae8c-d6c1db6b0e22 tempest-VolumesSnapshotListTestJSON-897081312 None] Create snapshot completed successfully Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Creating offline snapshot a17ffb10-743c-485c-b712-4ef0b605b86e of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd109f1-94bd-417d-9954-8391d061917c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:12 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.447s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e 1G Feb 27 02:12:13 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:13 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e 1G" returned: 0 in 0.480s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:13 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.446s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:14 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.426s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e is being set with open permissions: ugo+rw Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:14 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.395s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.799s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c4e76656-6e60-4f3f-9eab-4f3ac1c4bbd5 tempest-VolumesSnapshotListTestJSON-897081312 None] Create snapshot completed successfully Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Creating offline snapshot ab601202-630a-44af-a7b3-7b09e6398beb of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5540fd76-d66e-4f50-a219-29074636a055]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:15 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.460s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb 1G Feb 27 02:12:15 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb 1G" returned: 0 in 0.468s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb Feb 27 02:12:15 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb" returned: 0 in 0.411s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb is being set with open permissions: ugo+rw Feb 27 02:12:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb Feb 27 02:12:16 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb" returned: 0 in 0.395s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-77287188-6544-4789-a420-d568012bb6ef tempest-VolumesSnapshotListTestJSON-897081312 None] Create snapshot completed successfully Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-ab601202-630a-44af-a7b3-7b09e6398beb-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-ab601202-630a-44af-a7b3-7b09e6398beb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-ab601202-630a-44af-a7b3-7b09e6398beb" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-ab601202-630a-44af-a7b3-7b09e6398beb" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Deleting offline snapshot ab601202-630a-44af-a7b3-7b09e6398beb of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] snapshot_file for this snap is: volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6dfefd-b44f-4d77-9e83-f6f035f8085d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb Feb 27 02:12:17 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb" returned: 0 in 0.476s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0253ee-3b86-4257-8b02-76365e829c81]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:18 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb Feb 27 02:12:18 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb" returned: 0 in 0.486s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb Feb 27 02:12:19 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.ab601202-630a-44af-a7b3-7b09e6398beb" returned: 0 in 0.424s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-ab601202-630a-44af-a7b3-7b09e6398beb" released by "_delete_snapshot" :: held 1.916s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" released by "delete_snapshot" :: held 1.927s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Created reservations ['fcc3ce42-860e-4a10-9eeb-dc030555b6ea', 'd6dac68d-5714-477a-b98c-70c335dcce8e', '065be64c-18ce-4131-b6dc-04596c095d60', '313d0fa4-f39c-4261-be42-f1a79a80a4e0'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Delete snapshot completed successfully. Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-265baaae-c641-4817-a160-0ead3c9d65dc tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-ab601202-630a-44af-a7b3-7b09e6398beb-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-a17ffb10-743c-485c-b712-4ef0b605b86e-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-a17ffb10-743c-485c-b712-4ef0b605b86e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-a17ffb10-743c-485c-b712-4ef0b605b86e" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-a17ffb10-743c-485c-b712-4ef0b605b86e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Deleting offline snapshot a17ffb10-743c-485c-b712-4ef0b605b86e of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] snapshot_file for this snap is: volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda85be4-2060-4248-bee6-10e3a3ad79d2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:19 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[90befb7d-9bbb-44af-8a0e-19ede6a761b8]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:20 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:20 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:21 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:21 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e Feb 27 02:12:21 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:21 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.a17ffb10-743c-485c-b712-4ef0b605b86e" returned: 0 in 0.559s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-a17ffb10-743c-485c-b712-4ef0b605b86e" released by "_delete_snapshot" :: held 2.252s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" released by "delete_snapshot" :: held 2.270s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Created reservations ['3e97b135-702f-41d2-9ef9-b20cc937d237', '2f7050dc-cfeb-493a-9de2-bbdab4599b46', '375d1fd9-42bc-4141-88af-575bc9699448', 'b6c1c242-0649-495c-b15e-058e98555ebb'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Delete snapshot completed successfully. Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-86487603-bbc3-40f1-99f2-d4b3889551f4 tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-a17ffb10-743c-485c-b712-4ef0b605b86e-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-9074daf5-2c95-42d6-8f6c-3541a4e51b9f-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-9074daf5-2c95-42d6-8f6c-3541a4e51b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-9074daf5-2c95-42d6-8f6c-3541a4e51b9f" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-9074daf5-2c95-42d6-8f6c-3541a4e51b9f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Deleting offline snapshot 9074daf5-2c95-42d6-8f6c-3541a4e51b9f of volume 5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] snapshot_file for this snap is: volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fef687-9843-4e6a-a1f0-a03dbb53b3d4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:23 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:23 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:23 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b8ab480-1e3a-4af5-9795-b4c071eac727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:23 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a2a06-64e6-402f-a31e-ea887a9d7bac]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:23 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 Feb 27 02:12:23 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727" returned: 0 in 0.619s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:24 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f Feb 27 02:12:24 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727.9074daf5-2c95-42d6-8f6c-3541a4e51b9f" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-9074daf5-2c95-42d6-8f6c-3541a4e51b9f" released by "_delete_snapshot" :: held 2.218s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" released by "delete_snapshot" :: held 2.236s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:25 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Created reservations ['ab697275-e49b-499e-87fc-4db86399ddcc', '5bfabcf1-55fb-42a3-89ce-eb7f59373d2b', 'e7e2021f-2b3e-4c65-8a8e-c135a48e7ca8', '8337a8de-ae98-4704-99d6-0e0bbc9173bb'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Delete snapshot completed successfully. Feb 27 02:12:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-30acfedf-463e-4c48-87ad-a1a46369b17d tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-9074daf5-2c95-42d6-8f6c-3541a4e51b9f-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-5b8ab480-1e3a-4af5-9795-b4c071eac727-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-5b8ab480-1e3a-4af5-9795-b4c071eac727-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbffb99a-45ee-48c4-a8e1-ac1108533550]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 Feb 27 02:12:26 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727" returned: 0 in 0.468s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727 Feb 27 02:12:26 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-5b8ab480-1e3a-4af5-9795-b4c071eac727" returned: 0 in 0.439s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-quobyte-5b8ab480-1e3a-4af5-9795-b4c071eac727" released by "delete_volume" :: held 0.962s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Created reservations ['f4de1461-5b46-4418-9923-6878130f28ba', '4c11f4b1-bac9-4283-ac7c-3378693f39d3', '4a9bfea2-06d9-409f-86d4-25c7c80234c7', 'b276ee98-e67d-4bc5-86b1-07e68e7ae183'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:27 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.482s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Deleted volume successfully. Feb 27 02:12:27 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c41e925d-88cb-41f3-ac2c-9c1901717c7f tempest-VolumesSnapshotListTestJSON-897081312 None] Lock "cinder-5b8ab480-1e3a-4af5-9795-b4c071eac727-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Flow 'volume_create_manager' (2b96f7bf-66f7-4bf5-aa17-cbe57e0efccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d5faef-e433-4fad-905a-766302ff41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d5faef-e433-4fad-905a-766302ff41ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-953616636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b26949-c44b-480d-a89a-53b2b8f59bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d0d214e1e42efa1dad3e65a5f5f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:29Z,use_quota=True,user_id='d5c5bd637b5143c1915126cf2cb57a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54519772-4d20-489d-a366-9f5893e75459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54519772-4d20-489d-a366-9f5893e75459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043800cb-702c-412e-90ad-043147908257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043800cb-702c-412e-90ad-043147908257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b26949-c44b-480d-a89a-53b2b8f59bf3', 'volume_name': 'volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3', 'volume_size': 2}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8da242-4277-4e79-986d-0ee58273d89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8da242-4277-4e79-986d-0ee58273d89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8015cb9-6734-4b29-95e8-3d94e8088475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Volume f2b26949-c44b-480d-a89a-53b2b8f59bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3', 'volume_size': 2} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-953616636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b26949-c44b-480d-a89a-53b2b8f59bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d0d214e1e42efa1dad3e65a5f5f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:29Z,use_quota=True,user_id='d5c5bd637b5143c1915126cf2cb57a2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Creating volume f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:29 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 2147483648 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 2147483648 Feb 27 02:12:29 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 2147483648" returned: 0 in 0.504s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 Feb 27 02:12:30 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3" returned: 0 in 0.398s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8015cb9-6734-4b29-95e8-3d94e8088475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3', 'volume_size': 2}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3c135-8cc8-495e-805d-0ac18c3fe17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Volume volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 (f2b26949-c44b-480d-a89a-53b2b8f59bf3): created successfully Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3c135-8cc8-495e-805d-0ac18c3fe17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Flow 'volume_create_manager' (2b96f7bf-66f7-4bf5-aa17-cbe57e0efccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b4460e49-3851-4072-843d-3ae1f3108512 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Created volume successfully. Feb 27 02:12:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Creating offline snapshot 6c56efde-5b75-4537-bd38-f0cf99c4417a of volume f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:31 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb405d4-f233-4520-a5e8-f5f27a20be8b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 Feb 27 02:12:31 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3" returned: 0 in 0.493s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a 2G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a 2G Feb 27 02:12:32 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a 2G" returned: 0 in 0.593s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a Feb 27 02:12:32 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a" returned: 0 in 0.501s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a is being set with open permissions: ugo+rw Feb 27 02:12:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a Feb 27 02:12:33 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a" returned: 0 in 0.452s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info Feb 27 02:12:33 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info" returned: 0 in 0.536s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info is being set with open permissions: ugo+rw Feb 27 02:12:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info Feb 27 02:12:34 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.info" returned: 0 in 0.412s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a2df3138-bf58-4f11-ba29-edeab4516d49 tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Create snapshot completed successfully Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "cinder-6c56efde-5b75-4537-bd38-f0cf99c4417a-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-6c56efde-5b75-4537-bd38-f0cf99c4417a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "cinder-quobyte-6c56efde-5b75-4537-bd38-f0cf99c4417a" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-6c56efde-5b75-4537-bd38-f0cf99c4417a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Deleting offline snapshot 6c56efde-5b75-4537-bd38-f0cf99c4417a of volume f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] snapshot_file for this snap is: volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2f499-e032-4570-ace8-e742f3decd67]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:36 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a Feb 27 02:12:36 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a" returned: 0 in 0.498s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb8c4ca-0c97-4836-b27b-cbd990d3ddd1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:36 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 Feb 27 02:12:36 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a Feb 27 02:12:37 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a" returned: 0 in 0.443s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a Feb 27 02:12:37 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3.6c56efde-5b75-4537-bd38-f0cf99c4417a" returned: 0 in 0.406s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-6c56efde-5b75-4537-bd38-f0cf99c4417a" released by "_delete_snapshot" :: held 1.946s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" released by "delete_snapshot" :: held 1.960s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Created reservations ['95463fc2-1fa2-4944-9a90-f0ab79a82ec9', '2f2cae8c-c4f6-4e10-8afb-62fd46130481', '06b5a8e7-a142-4aac-8f8b-0af44aa93374', '945f0fc5-8ca3-4d74-8644-fad97e3ef26e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Delete snapshot completed successfully. Feb 27 02:12:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-197d3539-ca45-4a0f-a0bc-79aa7132b32f tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-6c56efde-5b75-4537-bd38-f0cf99c4417a-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "cinder-f2b26949-c44b-480d-a89a-53b2b8f59bf3-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-f2b26949-c44b-480d-a89a-53b2b8f59bf3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[407dcce2-6247-47b1-8c18-cbed4ff62739]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:38 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 Feb 27 02:12:38 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:38 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3" returned: 0 in 0.483s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:38 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3 Feb 27 02:12:38 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:39 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f2b26949-c44b-480d-a89a-53b2b8f59bf3" returned: 0 in 0.423s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-quobyte-f2b26949-c44b-480d-a89a-53b2b8f59bf3" released by "delete_volume" :: held 0.939s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Created reservations ['61c5dca1-e788-443b-a56d-b63c263bcc51', '976a88f1-8bfb-444f-9d64-fcb7f4dbf2bf', '96502af5-6dcb-4a4d-9193-5e55f781f526', '09186f48-4760-432e-b0d3-84fdd0b5efff'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:39 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:39 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:39 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.454s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:39 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Deleted volume successfully. Feb 27 02:12:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6ff5a099-6c01-46f6-83b7-b6a2f6fb9e7c tempest-VolumesSnapshotNegativeTestJSON-1290034981 None] Lock "cinder-f2b26949-c44b-480d-a89a-53b2b8f59bf3-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:40 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (837d9beb-3168-4122-b55a-d64ba90f3a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:40 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e241b5-da04-4f0e-b10e-7ae3d5c90552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e241b5-da04-4f0e-b10e-7ae3d5c90552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982106828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe91e39-0f45-48d5-9b21-c30c0a9d3b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:41Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b0c50d-94ac-46a0-880a-f06a5a565a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b0c50d-94ac-46a0-880a-f06a5a565a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e54bf9c-d253-4c04-982e-364518a0709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e54bf9c-d253-4c04-982e-364518a0709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe91e39-0f45-48d5-9b21-c30c0a9d3b01', 'volume_name': 'volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bd72e4-be13-4af5-a8c9-b8ecaeae83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bd72e4-be13-4af5-a8c9-b8ecaeae83d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11df375f-2c33-4e52-9c73-2036568f7b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume 4fe91e39-0f45-48d5-9b21-c30c0a9d3b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01', 'volume_size': 1} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982106828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe91e39-0f45-48d5-9b21-c30c0a9d3b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:41Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume 4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:41 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:41 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 1073741824 Feb 27 02:12:41 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:41 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 1073741824" returned: 0 in 0.484s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:41 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 Feb 27 02:12:41 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:41 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" returned: 0 in 0.395s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11df375f-2c33-4e52-9c73-2036568f7b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfb98df-aec1-42be-9c0e-b3b13ac874af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:41 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 (4fe91e39-0f45-48d5-9b21-c30c0a9d3b01): created successfully Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfb98df-aec1-42be-9c0e-b3b13ac874af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:41 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (837d9beb-3168-4122-b55a-d64ba90f3a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:41 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e7cc2ca7-2898-47a5-b9c0-56b69f41492b tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating offline snapshot aa14a103-cce4-464b-8392-ce588cae09bb of volume 4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eae849-d109-46aa-a012-1fe2f7ba9f78]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:43 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 Feb 27 02:12:43 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:43 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" returned: 0 in 0.461s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:43 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb 1G Feb 27 02:12:43 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:44 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb 1G" returned: 0 in 0.461s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:44 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb Feb 27 02:12:44 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:44 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb" returned: 0 in 0.396s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:44 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb is being set with open permissions: ugo+rw Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:44 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb Feb 27 02:12:44 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:44 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb" returned: 0 in 0.382s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:44 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info Feb 27 02:12:44 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:45 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info" returned: 0 in 0.399s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:45 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info is being set with open permissions: ugo+rw Feb 27 02:12:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:45 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info Feb 27 02:12:45 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:45 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.info" returned: 0 in 0.386s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:45 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9ba877f9-53a4-42dc-ac15-0b0e582a844a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Create snapshot completed successfully Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (7abbd970-50ab-4d1d-b2ff-b1c6b990dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da57d008-d8b9-4a52-a742-e21352b438bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da57d008-d8b9-4a52-a742-e21352b438bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374474770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ed22e9-29f9-46b9-84ba-0afe773e31ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b66f29-7897-444b-bb6f-c6dd71c7094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b66f29-7897-444b-bb6f-c6dd71c7094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc6cdfd-9332-42b3-9608-72eb3765ae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc6cdfd-9332-42b3-9608-72eb3765ae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ed22e9-29f9-46b9-84ba-0afe773e31ef', 'volume_name': 'volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b2b934-a91e-48be-af9b-a8dc3ad60a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b2b934-a91e-48be-af9b-a8dc3ad60a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296056d8-45ba-4c5a-90af-6c52affa6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume 49ed22e9-29f9-46b9-84ba-0afe773e31ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef', 'volume_size': 1} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374474770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ed22e9-29f9-46b9-84ba-0afe773e31ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume 49ed22e9-29f9-46b9-84ba-0afe773e31ef {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:46 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:46 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef 1073741824 Feb 27 02:12:46 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (0b97583e-b948-4f90-a849-f7998f8e77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e586b8-0f18-48ab-a815-23ae3c4557e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e586b8-0f18-48ab-a815-23ae3c4557e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547294452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ab23e7-20e7-4564-b09b-2bb222163efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec12cd19-c449-470e-aa01-1cc942831823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec12cd19-c449-470e-aa01-1cc942831823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f7530b-c988-4458-8f92-65db5c38066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f7530b-c988-4458-8f92-65db5c38066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ab23e7-20e7-4564-b09b-2bb222163efd', 'volume_name': 'volume-04ab23e7-20e7-4564-b09b-2bb222163efd', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b9f95c-eb3e-4937-a515-725ba6ac2ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b9f95c-eb3e-4937-a515-725ba6ac2ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c411e14-ce96-47ef-b3b1-6b44442f425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume 04ab23e7-20e7-4564-b09b-2bb222163efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ab23e7-20e7-4564-b09b-2bb222163efd', 'volume_size': 1} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (d30684fc-3c6a-4c89-aefa-5da0d68dc271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4246cdfc-d4d0-4e11-8b07-042ae0963e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4246cdfc-d4d0-4e11-8b07-042ae0963e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116179777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937c68c8-a8d3-47e9-bd7b-f4b32cd48346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a68de2-8a34-4819-8f6f-b45234aff67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a68de2-8a34-4819-8f6f-b45234aff67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b874fe1-d8b6-417c-b025-ba735e521ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b874fe1-d8b6-417c-b025-ba735e521ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937c68c8-a8d3-47e9-bd7b-f4b32cd48346', 'volume_name': 'volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7b7db0-ed88-4d6f-9a75-615526ce95ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7b7db0-ed88-4d6f-9a75-615526ce95ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac4f82-1790-407e-9b70-69ba7eeea9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:46 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume 937c68c8-a8d3-47e9-bd7b-f4b32cd48346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346', 'volume_size': 1} Feb 27 02:12:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (013568df-3ba6-4f58-83fb-6bede7d28b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcfd1ce-4943-41ed-83df-6e3c9fac9f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcfd1ce-4943-41ed-83df-6e3c9fac9f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145405375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87606a99-e94e-4e82-b2ca-ab32d589668b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8d084-6d11-4266-813a-3b6d151f756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8d084-6d11-4266-813a-3b6d151f756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069db2f3-b4c0-4cba-a349-fec3995a3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069db2f3-b4c0-4cba-a349-fec3995a3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87606a99-e94e-4e82-b2ca-ab32d589668b', 'volume_name': 'volume-87606a99-e94e-4e82-b2ca-ab32d589668b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103ab56-5f34-49e6-bc58-d92e3419de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103ab56-5f34-49e6-bc58-d92e3419de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc787c0-d9bc-49e1-a705-3f56470dcd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume 87606a99-e94e-4e82-b2ca-ab32d589668b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87606a99-e94e-4e82-b2ca-ab32d589668b', 'volume_size': 1} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:47 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef 1073741824" returned: 0 in 0.576s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:47 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef Feb 27 02:12:47 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (e82c64df-86c3-49f0-9a1e-21fdb6a88550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a7fc23-bc19-4d49-b80a-6e29db43791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a7fc23-bc19-4d49-b80a-6e29db43791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480224867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b532f59b-3f80-473a-ad6e-7ee6b97fed3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd416fcc-51c5-40e7-b483-74ca3c60d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd416fcc-51c5-40e7-b483-74ca3c60d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e66cfeb-f6a2-4343-96f6-e5e1d31b32ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e66cfeb-f6a2-4343-96f6-e5e1d31b32ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b532f59b-3f80-473a-ad6e-7ee6b97fed3a', 'volume_name': 'volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2269287d-6eb1-48a5-902d-c0895f91d764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2269287d-6eb1-48a5-902d-c0895f91d764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caa88de-24de-47c5-95b7-567659bcae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume b532f59b-3f80-473a-ad6e-7ee6b97fed3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a', 'volume_size': 1} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:47 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef" returned: 0 in 0.425s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547294452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ab23e7-20e7-4564-b09b-2bb222163efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume 04ab23e7-20e7-4564-b09b-2bb222163efd {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:47 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:47 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd 1073741824 Feb 27 02:12:47 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296056d8-45ba-4c5a-90af-6c52affa6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9636d5-8722-48a3-919a-e5b9d506cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:47 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef (49ed22e9-29f9-46b9-84ba-0afe773e31ef): created successfully Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9636d5-8722-48a3-919a-e5b9d506cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:47 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (7abbd970-50ab-4d1d-b2ff-b1c6b990dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ffe44b67-b85b-4c41-9854-01bda7c1d061 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:48 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd 1073741824" returned: 0 in 0.459s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:48 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd Feb 27 02:12:48 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:48 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd" returned: 0 in 0.403s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1116179777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937c68c8-a8d3-47e9-bd7b-f4b32cd48346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume 937c68c8-a8d3-47e9-bd7b-f4b32cd48346 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:48 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c411e14-ce96-47ef-b3b1-6b44442f425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ab23e7-20e7-4564-b09b-2bb222163efd', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:48 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 1073741824 Feb 27 02:12:48 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef1b61-e165-4b9d-817d-25335ab44f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:48 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-04ab23e7-20e7-4564-b09b-2bb222163efd (04ab23e7-20e7-4564-b09b-2bb222163efd): created successfully Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef1b61-e165-4b9d-817d-25335ab44f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (0b97583e-b948-4f90-a849-f7998f8e77f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:48 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-cb47130e-8146-4646-8019-9fc2ab074d67 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:48 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 1073741824" returned: 0 in 0.442s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:49 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 Feb 27 02:12:49 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:49 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" returned: 0 in 0.405s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145405375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87606a99-e94e-4e82-b2ca-ab32d589668b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume 87606a99-e94e-4e82-b2ca-ab32d589668b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:49 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac4f82-1790-407e-9b70-69ba7eeea9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c9c78b-8bb8-496f-840e-2bf9f5a6c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:49 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b 1073741824 Feb 27 02:12:49 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:49 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 (937c68c8-a8d3-47e9-bd7b-f4b32cd48346): created successfully Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c9c78b-8bb8-496f-840e-2bf9f5a6c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (d30684fc-3c6a-4c89-aefa-5da0d68dc271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:49 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-7ae35b14-8581-4518-b53f-1f61d312ce13 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:49 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b 1073741824" returned: 0 in 0.500s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:49 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b Feb 27 02:12:49 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:50 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b" returned: 0 in 0.404s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480224867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b532f59b-3f80-473a-ad6e-7ee6b97fed3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e95d8f05c442afa4306074e8c32476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:47Z,use_quota=True,user_id='79836797b08e498daf82ee8ba6b977d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Creating volume b532f59b-3f80-473a-ad6e-7ee6b97fed3a {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:50 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc787c0-d9bc-49e1-a705-3f56470dcd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87606a99-e94e-4e82-b2ca-ab32d589668b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccc4778-de7d-462c-b056-28f3159d08c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:50 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a 1073741824 Feb 27 02:12:50 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:50 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-87606a99-e94e-4e82-b2ca-ab32d589668b (87606a99-e94e-4e82-b2ca-ab32d589668b): created successfully Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccc4778-de7d-462c-b056-28f3159d08c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (013568df-3ba6-4f58-83fb-6bede7d28b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d4b94ed8-1f45-4ca0-ab34-88e316c11cf9 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:50 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a 1073741824" returned: 0 in 0.518s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:50 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a Feb 27 02:12:50 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:51 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" returned: 0 in 0.429s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caa88de-24de-47c5-95b7-567659bcae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e984d1b-5962-4868-b702-1dfc962d375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Volume volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a (b532f59b-3f80-473a-ad6e-7ee6b97fed3a): created successfully Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e984d1b-5962-4868-b702-1dfc962d375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Flow 'volume_create_manager' (e82c64df-86c3-49f0-9a1e-21fdb6a88550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:51 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-217edd6d-b76f-4750-8d34-8c066bb27814 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created volume successfully. Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-b532f59b-3f80-473a-ad6e-7ee6b97fed3a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-b532f59b-3f80-473a-ad6e-7ee6b97fed3a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f99c62-5c6d-4920-9e4d-8c52be1e7d40]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:52 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a Feb 27 02:12:52 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:52 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:52 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a Feb 27 02:12:52 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:53 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" returned: 0 in 0.406s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-b532f59b-3f80-473a-ad6e-7ee6b97fed3a" released by "delete_volume" :: held 0.913s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=66,cinder:UPDATE=80,cinder:INSERT=23,cinder:DELETE=8 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:53 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=76,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=8 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:53 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['dd5adb5c-8561-4d5b-8f57-30ccafb74368', '5841b964-849b-4a97-a80e-0a07a8a5db9f', 'ffff5b42-bd87-4bdb-85d4-56cb70f82730', '1fd69dde-ec5c-44c8-b5eb-5b2ba92e4fe2'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:54 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:54 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-87606a99-e94e-4e82-b2ca-ab32d589668b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-87606a99-e94e-4e82-b2ca-ab32d589668b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-87606a99-e94e-4e82-b2ca-ab32d589668b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-87606a99-e94e-4e82-b2ca-ab32d589668b" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a74fc7-1ae9-4c90-8a9b-18e01e9b7f2f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:54 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b Feb 27 02:12:54 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:54 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.462s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:54 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:12:54 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-473331f0-f05f-4e2f-8211-729d69b057cc tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-b532f59b-3f80-473a-ad6e-7ee6b97fed3a-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:55 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b" returned: 0 in 0.496s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:55 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b Feb 27 02:12:55 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:55 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-87606a99-e94e-4e82-b2ca-ab32d589668b" returned: 0 in 0.409s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-87606a99-e94e-4e82-b2ca-ab32d589668b" released by "delete_volume" :: held 0.927s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['b0714f2e-4e29-4292-bac2-2cf25129f3a7', '8b9259f3-de2f-46a2-8296-b84e0b1320a7', '831de0da-5517-4fbf-99d1-d3dd6372e7a0', '4016b32e-9475-4185-a619-c7ff6d9b751e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:55 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:55 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:56 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.421s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-74f3310b-3629-4bcd-bd39-2071f79a8b94 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-87606a99-e94e-4e82-b2ca-ab32d589668b-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-937c68c8-a8d3-47e9-bd7b-f4b32cd48346-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-937c68c8-a8d3-47e9-bd7b-f4b32cd48346-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ec393-b97b-4813-b354-a15f3d732415]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:57 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 Feb 27 02:12:57 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:57 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" returned: 0 in 0.467s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:57 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346 Feb 27 02:12:57 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:57 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" returned: 0 in 0.420s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:57 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-937c68c8-a8d3-47e9-bd7b-f4b32cd48346" released by "delete_volume" :: held 0.915s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:58 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['ae58a055-90a3-49a7-8480-0b6bfd2224f2', 'fd63ad47-4274-4417-b889-253ec0ca3b94', '7ce19e78-b2d0-4b00-9557-4dfe00eab533', 'cf0aa1b8-51d3-43c8-8805-b7c894107dbb'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:59 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:12:59 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-04ab23e7-20e7-4564-b09b-2bb222163efd-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-04ab23e7-20e7-4564-b09b-2bb222163efd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:59 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.384s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:59 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-04ab23e7-20e7-4564-b09b-2bb222163efd" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-04ab23e7-20e7-4564-b09b-2bb222163efd" acquired by "delete_volume" :: waited 0.006s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18d9be-30c7-40ba-9f2a-91540a6f4047]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:00 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd Feb 27 02:13:00 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c9cc1fd3-300b-4089-a6fc-f3c7190fba8d tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-937c68c8-a8d3-47e9-bd7b-f4b32cd48346-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:00 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:00 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd Feb 27 02:13:00 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:01 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-04ab23e7-20e7-4564-b09b-2bb222163efd" returned: 0 in 0.417s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-04ab23e7-20e7-4564-b09b-2bb222163efd" released by "delete_volume" :: held 0.975s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:02 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['1f0872c0-d06a-42ef-88b1-6e095e3e5bf4', '0711ff39-0728-4366-a185-a224d69f1285', 'a8a264c5-30f6-4ee5-8eba-c570536302a4', '3bda43b5-5818-449b-941c-a7fd94755b76'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:05 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:05 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-49ed22e9-29f9-46b9-84ba-0afe773e31ef-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-49ed22e9-29f9-46b9-84ba-0afe773e31ef-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-49ed22e9-29f9-46b9-84ba-0afe773e31ef" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-49ed22e9-29f9-46b9-84ba-0afe773e31ef" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9c288-22af-4ca6-a4bd-433b9b000d8b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:05 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef Feb 27 02:13:05 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:05 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.407s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:13:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-78c02487-9d97-4242-a83a-b2cd9c77cbf4 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-04ab23e7-20e7-4564-b09b-2bb222163efd-delete_volume" released by "delete_volume" :: held 6.251s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:06 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef" returned: 0 in 0.448s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:06 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef Feb 27 02:13:06 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:06 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-49ed22e9-29f9-46b9-84ba-0afe773e31ef" returned: 0 in 0.372s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-49ed22e9-29f9-46b9-84ba-0afe773e31ef" released by "delete_volume" :: held 0.846s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['6959227d-3b4c-4423-8e65-06b0a5663cd8', 'a6c52721-d092-41ea-a342-5a200c62233c', 'ed7315d6-75a3-4a79-a92b-40e228f71f80', '6c3adcea-315c-4adb-a66c-3ed03e15ff8f'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:06 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:06 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-aa14a103-cce4-464b-8392-ce588cae09bb-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-aa14a103-cce4-464b-8392-ce588cae09bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-aa14a103-cce4-464b-8392-ce588cae09bb" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-aa14a103-cce4-464b-8392-ce588cae09bb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleting offline snapshot aa14a103-cce4-464b-8392-ce588cae09bb of volume 4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] snapshot_file for this snap is: volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af1d72-252c-40dc-8343-489d0c7ec59f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:06 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb Feb 27 02:13:06 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:06 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.417s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:06 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:13:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-fbfb6978-08fa-483f-be9b-03a1f2fa073a tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-49ed22e9-29f9-46b9-84ba-0afe773e31ef-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:07 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb" returned: 0 in 0.457s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa51f8-303f-49fc-ba2f-8a49f1939922]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:07 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 Feb 27 02:13:07 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:07 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" returned: 0 in 0.442s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:07 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb Feb 27 02:13:07 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:08 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb" returned: 0 in 0.429s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:08 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb Feb 27 02:13:08 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:08 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01.aa14a103-cce4-464b-8392-ce588cae09bb" returned: 0 in 0.378s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-aa14a103-cce4-464b-8392-ce588cae09bb" released by "_delete_snapshot" :: held 1.756s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" released by "delete_snapshot" :: held 1.767s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['55c37dcc-c8fd-4365-ba25-4b57c7270fc4', 'ad20660d-ca68-4240-a27e-908543f34fa4', 'cd38db95-9ebb-43ac-9ee3-76076eafcf97', 'db12ca31-8cfc-4095-99d5-5f7a0e7b8b95'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Delete snapshot completed successfully. Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-613ace86-349e-43a3-a7b7-6a6360044984 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-aa14a103-cce4-464b-8392-ce588cae09bb-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a7d118-8e7d-40a4-acd6-81b324ce60a5]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:08 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 Feb 27 02:13:08 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:09 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" returned: 0 in 0.439s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:09 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01 Feb 27 02:13:09 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:09 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" returned: 0 in 0.395s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-quobyte-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01" released by "delete_volume" :: held 0.863s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Created reservations ['9fbeff18-acfa-473e-9fb0-2480104e3e7b', '305753c3-e91f-4e5d-afe4-e3b72d1aea83', 'bd3f0bba-f051-45d6-a1ca-5e87b4935830', 'e7517e1b-8855-4a29-a0c2-601d1e945dc2'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:09 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:09 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:10 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.429s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:10 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Deleted volume successfully. Feb 27 02:13:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1ca6ae9b-be7e-4310-b0a8-a0cf3a487be7 tempest-CreateVolumesFromSnapshotTest-1803033740 None] Lock "cinder-4fe91e39-0f45-48d5-9b21-c30c0a9d3b01-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (3daaeb78-0326-487b-bad8-08e5190c00b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc8d0bb-ffc6-4370-838b-e465a12206ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc8d0bb-ffc6-4370-838b-e465a12206ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-177237994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec284c44-0c27-4f32-a2c1-5d89c5a0abf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:12Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bb529-a4d4-4baa-9361-82186f4ca812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bb529-a4d4-4baa-9361-82186f4ca812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c8144e-bf2f-40ed-a8fc-242211bd230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c8144e-bf2f-40ed-a8fc-242211bd230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec284c44-0c27-4f32-a2c1-5d89c5a0abf0', 'volume_name': 'volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bf5679-663e-41a4-90a1-54b6c075b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bf5679-663e-41a4-90a1-54b6c075b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cc2359-1155-4866-ba91-46002c6a3d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:11 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Volume ec284c44-0c27-4f32-a2c1-5d89c5a0abf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0', 'volume_size': 1} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-177237994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec284c44-0c27-4f32-a2c1-5d89c5a0abf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:12Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Creating volume ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:11 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:11 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 1073741824 Feb 27 02:13:11 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:12 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 1073741824" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:12 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:12 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:12 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.386s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cc2359-1155-4866-ba91-46002c6a3d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aedf95-1d89-44b1-b86e-17cfc4771a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:12 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Volume volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 (ec284c44-0c27-4f32-a2c1-5d89c5a0abf0): created successfully Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aedf95-1d89-44b1-b86e-17cfc4771a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (3daaeb78-0326-487b-bad8-08e5190c00b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:12 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-de9bf14e-ca2d-4909-9f86-0be872ccfa58 tempest-VolumeDependencyTests-454368000 None] Created volume successfully. Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Creating offline snapshot 9a9a0274-df6e-4760-8e28-cb65b2813256 of volume ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[58978ff7-b844-4a8a-a7c2-e14d002c7780]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:12 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:12 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:13 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.453s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:13 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 1G Feb 27 02:13:13 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:13 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:13 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:13 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 1G" returned: 0 in 0.455s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:13 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:13 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:13 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.421s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:14 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.409s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:14 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 is being set with open permissions: ugo+rw Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:14 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:14 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:14 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.376s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:14 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info Feb 27 02:13:14 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:14 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info" returned: 0 in 0.387s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:14 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info is being set with open permissions: ugo+rw Feb 27 02:13:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:14 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info Feb 27 02:13:14 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:15 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.info" returned: 0 in 0.378s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ad7d8daf-3556-4306-a46d-b3e91054e9b3 tempest-VolumeDependencyTests-454368000 None] Create snapshot completed successfully Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (c4cda873-eb24-4403-a238-5779ad23129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b4dd76-7228-42ed-a89c-7323c6811d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b4dd76-7228-42ed-a89c-7323c6811d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1212927256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3422f26a-2391-49ed-8836-536d2cf649f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a9a0274-df6e-4760-8e28-cb65b2813256,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:16Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b91dce-aa38-478d-817f-3f7ddaa6d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b91dce-aa38-478d-817f-3f7ddaa6d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c190b382-019e-49fb-a05b-46d8240b7ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c190b382-019e-49fb-a05b-46d8240b7ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3422f26a-2391-49ed-8836-536d2cf649f1', 'volume_name': 'volume-3422f26a-2391-49ed-8836-536d2cf649f1', 'volume_size': 1, 'snapshot_id': '9a9a0274-df6e-4760-8e28-cb65b2813256'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfc108-108d-4f99-9a1b-eda8bd73a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfc108-108d-4f99-9a1b-eda8bd73a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4902e9a1-a298-48e7-88f9-46f75a91d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:16 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Volume 3422f26a-2391-49ed-8836-536d2cf649f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3422f26a-2391-49ed-8836-536d2cf649f1', 'volume_size': 1, 'snapshot_id': '9a9a0274-df6e-4760-8e28-cb65b2813256'} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256-3422f26a-2391-49ed-8836-536d2cf649f1" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256-3422f26a-2391-49ed-8836-536d2cf649f1" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Creating volume 3422f26a-2391-49ed-8836-536d2cf649f1 from snapshot 9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] snapshot: 9a9a0274-df6e-4760-8e28-cb65b2813256, volume: 3422f26a-2391-49ed-8836-536d2cf649f1, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e9a4b-50b3-421c-84cb-79cf399d3bb2]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:16 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:16 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:16 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.471s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce040a-3677-4da4-ad6a-5e15c4ae728a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:16 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:16 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:17 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:17 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:13:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:17 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 Feb 27 02:13:17 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:18 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1" returned: 0 in 1.807s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e556636-7325-4040-9f5b-22d97c1c3f28]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:19 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:19 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:19 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.573s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:13:19 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Converted 1024.00 MB image at 566.32 MB/s Feb 27 02:13:19 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 is being set with open permissions: ugo+rw Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:19 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 Feb 27 02:13:19 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:19 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1" returned: 0 in 0.383s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" released by "_copy_volume_from_snapshot" :: held 3.745s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256-3422f26a-2391-49ed-8836-536d2cf649f1" released by "_create_volume_from_snapshot" :: held 3.763s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.771s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4902e9a1-a298-48e7-88f9-46f75a91d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3422f26a-2391-49ed-8836-536d2cf649f1', 'volume_size': 1, 'snapshot_id': '9a9a0274-df6e-4760-8e28-cb65b2813256'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b1efa-d730-4b11-98ce-46234033035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:20 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Volume volume-3422f26a-2391-49ed-8836-536d2cf649f1 (3422f26a-2391-49ed-8836-536d2cf649f1): created successfully Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624b1efa-d730-4b11-98ce-46234033035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (c4cda873-eb24-4403-a238-5779ad23129d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:20 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-51b18fda-ae46-4713-ab70-e68086a3d025 tempest-VolumeDependencyTests-454368000 None] Created volume successfully. Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-9a9a0274-df6e-4760-8e28-cb65b2813256-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-9a9a0274-df6e-4760-8e28-cb65b2813256-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Deleting offline snapshot 9a9a0274-df6e-4760-8e28-cb65b2813256 of volume ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] snapshot_file for this snap is: volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[882bf757-2509-4587-b50c-3592bfc7b991]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:20 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:20 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:20 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.488s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be1908-6073-4cfb-90bc-35fc9bb84e5e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:20 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:20 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:21 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.512s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:21 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:21 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:21 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.463s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:21 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256 Feb 27 02:13:21 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:22 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0.9a9a0274-df6e-4760-8e28-cb65b2813256" returned: 0 in 0.414s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-9a9a0274-df6e-4760-8e28-cb65b2813256" released by "_delete_snapshot" :: held 1.930s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" released by "delete_snapshot" :: held 1.941s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Created reservations ['917456a2-034e-4b33-bc00-452d5e117444', 'fd7cc0c9-752a-4806-8fe7-cce101bdadd0', '88b4dc62-7607-4396-afa1-5bd4e0d723d1', 'c8e6e700-4f4a-4c96-867e-06a10164b95e'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:22 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Delete snapshot completed successfully. Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6d280475-8931-4d41-8919-7241716680b5 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-9a9a0274-df6e-4760-8e28-cb65b2813256-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "cinder-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0ba79-f435-4744-902a-929a4ec24e3a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:22 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:22 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:23 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:23 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0 Feb 27 02:13:23 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:23 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" returned: 0 in 0.475s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0" released by "delete_volume" :: held 1.022s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Created reservations ['d118cf3d-8d15-43bc-8d3c-d130e62be304', 'b015e1a3-a192-4426-af0c-6637e65abc56', '4e2f9bc5-13bc-44a7-b4dc-392b0122505e', '610b5660-c98d-4335-a357-031b5488f8dd'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:23 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:23 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:24 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.428s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:24 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Deleted volume successfully. Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-f599dfe7-f376-4cf1-a942-63d799d2a70b tempest-VolumeDependencyTests-454368000 None] Lock "cinder-ec284c44-0c27-4f32-a2c1-5d89c5a0abf0-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (2476816c-6618-4aa3-acb1-cdee95a1e997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a94cd01-905b-4996-ac23-828b4e0cb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a94cd01-905b-4996-ac23-828b4e0cb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-165753583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1701f2b6-36a5-4051-a25d-869adf8c3875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:25Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4996d2-35cf-48c9-8bd1-7e076333de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4996d2-35cf-48c9-8bd1-7e076333de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d447cd46-bfa1-4276-9e39-bb4b13deaa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d447cd46-bfa1-4276-9e39-bb4b13deaa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1701f2b6-36a5-4051-a25d-869adf8c3875', 'volume_name': 'volume-1701f2b6-36a5-4051-a25d-869adf8c3875', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8672527-0a50-4020-9a54-f0ef64b5c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8672527-0a50-4020-9a54-f0ef64b5c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81a0bef-909e-4219-8252-cdabad5f8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:24 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Volume 1701f2b6-36a5-4051-a25d-869adf8c3875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1701f2b6-36a5-4051-a25d-869adf8c3875', 'volume_size': 1} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-165753583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1701f2b6-36a5-4051-a25d-869adf8c3875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:25Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Creating volume 1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:24 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:24 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 1073741824 Feb 27 02:13:24 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:25 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 1073741824" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:25 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:25 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:25 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.378s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81a0bef-909e-4219-8252-cdabad5f8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1701f2b6-36a5-4051-a25d-869adf8c3875', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6cdc5-e324-4b94-87d8-9dc7c7ebb4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:25 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Volume volume-1701f2b6-36a5-4051-a25d-869adf8c3875 (1701f2b6-36a5-4051-a25d-869adf8c3875): created successfully Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6cdc5-e324-4b94-87d8-9dc7c7ebb4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (2476816c-6618-4aa3-acb1-cdee95a1e997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-51616814-2bd8-468c-ab8a-073d5db34920 tempest-VolumeDependencyTests-454368000 None] Created volume successfully. Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (7fe27585-c4a3-43ac-bd09-bb5d7005074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130effac-0dc6-4ce7-8053-9d6f29ca57d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130effac-0dc6-4ce7-8053-9d6f29ca57d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1461578923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d974c436-22a9-4d61-8360-1cf8fed99568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ebace6995d4e179b3caeab1331fd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1701f2b6-36a5-4051-a25d-869adf8c3875,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:26Z,use_quota=True,user_id='27e264d5cc2846b9bb32410a37acd4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449c95b3-8246-4d82-a6d7-137ee26c7ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449c95b3-8246-4d82-a6d7-137ee26c7ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9b39f-09d5-42f8-b280-4e6731783e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9b39f-09d5-42f8-b280-4e6731783e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd974c436-22a9-4d61-8360-1cf8fed99568', 'volume_name': 'volume-d974c436-22a9-4d61-8360-1cf8fed99568', 'volume_size': 1, 'source_volid': '1701f2b6-36a5-4051-a25d-869adf8c3875', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7748dc3-4377-45a6-b6b9-ffbb53f42d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7748dc3-4377-45a6-b6b9-ffbb53f42d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fff4307-0be6-44cd-8c87-96a322febd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Volume d974c436-22a9-4d61-8360-1cf8fed99568: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d974c436-22a9-4d61-8360-1cf8fed99568', 'volume_size': 1, 'source_volid': '1701f2b6-36a5-4051-a25d-869adf8c3875', 'source_volstatus': 'available'} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:26 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Cloning volume 1701f2b6-36a5-4051-a25d-869adf8c3875 to volume d974c436-22a9-4d61-8360-1cf8fed99568 Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Creating offline snapshot f6336452-95a4-40ac-a76e-96ed616815f2 of volume 1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e8446-0bc5-4dd7-86bb-e1ee608e414a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:26 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:26 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:26 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.474s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:26 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 1G Feb 27 02:13:26 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:27 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 1G" returned: 0 in 0.470s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1701f2b6-36a5-4051-a25d-869adf8c3875 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:27 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1701f2b6-36a5-4051-a25d-869adf8c3875 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:27 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:27 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1701f2b6-36a5-4051-a25d-869adf8c3875 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.417s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:27 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 is being set with open permissions: ugo+rw Feb 27 02:13:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:27 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:27 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:28 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.394s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:28 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info Feb 27 02:13:28 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:28 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info" returned: 0 in 0.396s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:28 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info is being set with open permissions: ugo+rw Feb 27 02:13:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:28 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info Feb 27 02:13:28 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:29 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.info" returned: 0 in 0.410s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] snapshot: f6336452-95a4-40ac-a76e-96ed616815f2, volume: d974c436-22a9-4d61-8360-1cf8fed99568, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc49d47-e33d-4914-95ae-5c567b83da43]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:29 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:29 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:29 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.463s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1701f2b6-36a5-4051-a25d-869adf8c3875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec21382b-c628-4214-89c6-066864be245d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:29 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:29 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:30 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.461s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:30 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:13:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:30 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 Feb 27 02:13:30 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:32 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568" returned: 0 in 1.983s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3304ef-d046-46bb-b37d-73e4d794eb13]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:32 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:32 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:32 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.583s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:13:32 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Converted 1024.00 MB image at 516.04 MB/s Feb 27 02:13:32 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 is being set with open permissions: ugo+rw Feb 27 02:13:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:32 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 Feb 27 02:13:32 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:33 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568" returned: 0 in 0.398s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" released by "_copy_volume_from_snapshot" :: held 3.932s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-f6336452-95a4-40ac-a76e-96ed616815f2" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-f6336452-95a4-40ac-a76e-96ed616815f2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Deleting offline snapshot f6336452-95a4-40ac-a76e-96ed616815f2 of volume 1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] snapshot_file for this snap is: volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b774219-1516-430d-aa70-a572370da446]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:33 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:33 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:34 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1701f2b6-36a5-4051-a25d-869adf8c3875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c100e-ab39-4085-ab25-ee08ca52d650]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:34 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:34 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:34 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.472s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:34 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:34 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:34 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.421s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:34 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2 Feb 27 02:13:34 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:35 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875.f6336452-95a4-40ac-a76e-96ed616815f2" returned: 0 in 0.383s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-f6336452-95a4-40ac-a76e-96ed616815f2" released by "_delete_snapshot" :: held 1.840s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.475s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fff4307-0be6-44cd-8c87-96a322febd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d974c436-22a9-4d61-8360-1cf8fed99568', 'volume_size': 1, 'source_volid': '1701f2b6-36a5-4051-a25d-869adf8c3875', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32861f69-50f9-4525-8f82-f650c1a39325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:36 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Volume volume-d974c436-22a9-4d61-8360-1cf8fed99568 (d974c436-22a9-4d61-8360-1cf8fed99568): created successfully Feb 27 02:13:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32861f69-50f9-4525-8f82-f650c1a39325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:36 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Flow 'volume_create_manager' (7fe27585-c4a3-43ac-bd09-bb5d7005074b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:37 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-571c2d63-3d64-4df1-a54f-5f0e2fcf1b8d tempest-VolumeDependencyTests-454368000 None] Created volume successfully. Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-1701f2b6-36a5-4051-a25d-869adf8c3875-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-1701f2b6-36a5-4051-a25d-869adf8c3875-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-1701f2b6-36a5-4051-a25d-869adf8c3875" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-1701f2b6-36a5-4051-a25d-869adf8c3875" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccf3715-536c-4811-8149-d42b7021859a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:39 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:39 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:39 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.448s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:39 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875 Feb 27 02:13:39 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:39 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1701f2b6-36a5-4051-a25d-869adf8c3875" returned: 0 in 0.395s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-1701f2b6-36a5-4051-a25d-869adf8c3875" released by "delete_volume" :: held 0.870s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:40 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Created reservations ['b9723ece-608b-46bd-aa53-dd356bbd4c9a', '134710e7-38e1-49fb-93eb-7baa6939ecd4', 'b487db76-5e40-482f-9573-4a6b03b768dc', '296feffd-c317-4472-ac07-7c9d387aa2c0'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:41 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:41 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-d974c436-22a9-4d61-8360-1cf8fed99568-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-d974c436-22a9-4d61-8360-1cf8fed99568-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eebdc7-4a9c-4f1b-a18d-3f3fe2e77067]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:42 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 Feb 27 02:13:42 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:42 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.487s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Deleted volume successfully. Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4f45bae4-47ea-4e1a-bba1-54f1d1229232 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-1701f2b6-36a5-4051-a25d-869adf8c3875-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:42 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568" returned: 0 in 0.513s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:42 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568 Feb 27 02:13:42 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:42 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d974c436-22a9-4d61-8360-1cf8fed99568" returned: 0 in 0.389s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-d974c436-22a9-4d61-8360-1cf8fed99568" released by "delete_volume" :: held 0.929s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Created reservations ['a8046fab-bf4f-4458-98a2-43da0de87739', '5aff530f-71e9-4059-b8cf-2c203c345cb3', '3ff44e71-1092-4625-b1e9-427b1479c9f9', '43d1ccb0-e982-4589-89c0-24ded1078f16'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:42 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:42 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-3422f26a-2391-49ed-8836-536d2cf649f1-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-3422f26a-2391-49ed-8836-536d2cf649f1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ffe3db-bffd-443e-a487-1ad957b65f36]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:43 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 Feb 27 02:13:43 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.408s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Deleted volume successfully. Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-db6935b1-3866-4b40-9172-f15f475e6f80 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-d974c436-22a9-4d61-8360-1cf8fed99568-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:43 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1" returned: 0 in 0.467s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:43 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1 Feb 27 02:13:43 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:43 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3422f26a-2391-49ed-8836-536d2cf649f1" returned: 0 in 0.382s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-quobyte-3422f26a-2391-49ed-8836-536d2cf649f1" released by "delete_volume" :: held 0.870s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:43 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Created reservations ['e04511d3-84b1-4881-84e7-9ab7788611ff', '2b15ec72-f52a-40cc-a86a-b8a2d4f8016b', '49f98a79-ed0d-4fe3-b3ef-7b0e4959822a', '112d07a0-94d5-4dca-920a-4f32be0d8209'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:44 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:13:44 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:44 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.447s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:13:44 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Deleted volume successfully. Feb 27 02:13:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d2bf3e14-59bf-41ce-9b97-b17c3893b7b0 tempest-VolumeDependencyTests-454368000 None] Lock "cinder-3422f26a-2391-49ed-8836-536d2cf649f1-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (46a35939-f197-4e8c-823f-b07821ac6af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7adf81-aff1-45d6-848e-4c8a137b168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7adf81-aff1-45d6-848e-4c8a137b168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329210218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc2df8b-1333-441c-98fe-e0625a03a6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:51Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5947f794-102c-4b0c-b7ff-d59ac7f429d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5947f794-102c-4b0c-b7ff-d59ac7f429d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8e17b9-54fa-4858-925b-6330a11f2da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8e17b9-54fa-4858-925b-6330a11f2da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc2df8b-1333-441c-98fe-e0625a03a6f5', 'volume_name': 'volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb27912-e6f4-4fdc-b10e-9a9d5e078be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb27912-e6f4-4fdc-b10e-9a9d5e078be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f60c3c-157e-46b6-b5ad-1155f2494f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Volume 8dc2df8b-1333-441c-98fe-e0625a03a6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5', 'volume_size': 1} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329210218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc2df8b-1333-441c-98fe-e0625a03a6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:51Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Creating volume 8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:51 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:51 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 1073741824 Feb 27 02:13:51 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (099f6988-e403-4cd9-8362-1edc7a8a0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5cc725-0296-43f9-8765-4de5ea1ff168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5cc725-0296-43f9-8765-4de5ea1ff168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393605316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7144a9c3-12f2-46fc-97e1-162a2a12f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:51Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598d3214-337d-4b5c-824b-6f4517f79808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598d3214-337d-4b5c-824b-6f4517f79808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a503ab9f-0624-4436-a51d-dd47bdedacb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a503ab9f-0624-4436-a51d-dd47bdedacb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7144a9c3-12f2-46fc-97e1-162a2a12f138', 'volume_name': 'volume-7144a9c3-12f2-46fc-97e1-162a2a12f138', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71b70a0-08c8-4e6c-87e1-d462d45d4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d71b70a0-08c8-4e6c-87e1-d462d45d4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73adc4d9-1dcf-49d2-abf5-03eedf671cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume 7144a9c3-12f2-46fc-97e1-162a2a12f138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7144a9c3-12f2-46fc-97e1-162a2a12f138', 'volume_size': 1} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (28bbc68f-5dc1-4675-a79d-d6f4b2680d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad395048-914d-4f93-8b94-12ae5eb5a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad395048-914d-4f93-8b94-12ae5eb5a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1180167254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92d3c5f-4d82-40bc-a0ce-96e3c7a12164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565a596e-98a2-47f8-9b9a-09e3df692c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565a596e-98a2-47f8-9b9a-09e3df692c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99456795-463e-4df0-b37f-341f5695c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99456795-463e-4df0-b37f-341f5695c655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92d3c5f-4d82-40bc-a0ce-96e3c7a12164', 'volume_name': 'volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92ab10c-7597-4fa8-9a66-fab415cb35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92ab10c-7597-4fa8-9a66-fab415cb35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3c5dc1-04b7-4038-8b02-b30ce469f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Volume d92d3c5f-4d82-40bc-a0ce-96e3c7a12164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164', 'volume_size': 1} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (1bdae17b-dded-4e8a-a7dd-7e7a1900704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961c0877-ff2b-49c2-93b2-e76f808363f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961c0877-ff2b-49c2-93b2-e76f808363f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315861367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff47407-ef22-4cb8-ae04-7d019af677bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca43c953-0b5b-4750-8db4-cc2a683c9ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca43c953-0b5b-4750-8db4-cc2a683c9ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb472f15-0aa4-4ad4-8c50-e9b2b01c49fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb472f15-0aa4-4ad4-8c50-e9b2b01c49fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff47407-ef22-4cb8-ae04-7d019af677bf', 'volume_name': 'volume-4ff47407-ef22-4cb8-ae04-7d019af677bf', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac563203-5dd2-4788-813b-b0e2f6f0614f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac563203-5dd2-4788-813b-b0e2f6f0614f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7eabd6-8b12-4af0-bcaa-274f5c1a0667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:51 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Volume 4ff47407-ef22-4cb8-ae04-7d019af677bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff47407-ef22-4cb8-ae04-7d019af677bf', 'volume_size': 1} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 1073741824" returned: 0 in 0.666s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:52 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:13:52 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (3bacedf1-3619-40c8-9ca1-93ec826a9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4cef4-479b-43d5-812a-35dc6d1dfa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4cef4-479b-43d5-812a-35dc6d1dfa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580642510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9784dcc6-5656-457b-b0c6-3680195b5cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f52de4-3c16-49f3-942c-572a03cf71e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f52de4-3c16-49f3-942c-572a03cf71e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b6b7cf-595f-4781-b057-06816f814cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b6b7cf-595f-4781-b057-06816f814cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9784dcc6-5656-457b-b0c6-3680195b5cf3', 'volume_name': 'volume-9784dcc6-5656-457b-b0c6-3680195b5cf3', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44389160-4379-4e5b-bdfc-56f601da59a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44389160-4379-4e5b-bdfc-56f601da59a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6789040-f9b5-4f14-9fba-91c58de228e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Volume 9784dcc6-5656-457b-b0c6-3680195b5cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9784dcc6-5656-457b-b0c6-3680195b5cf3', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (d42c3356-c871-4b10-833c-6c300141e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2994878-caa9-4798-bce5-165354ee0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2994878-caa9-4798-bce5-165354ee0f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012511552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccad09de-c007-4234-94ef-09c103d6d141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f39b24-43cc-4c52-8c6d-2a7b8cf15937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f39b24-43cc-4c52-8c6d-2a7b8cf15937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ed9972-b14a-49a3-a3c9-915eb4cc3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ed9972-b14a-49a3-a3c9-915eb4cc3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccad09de-c007-4234-94ef-09c103d6d141', 'volume_name': 'volume-ccad09de-c007-4234-94ef-09c103d6d141', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9460d0c-6a72-4602-9cda-88cfef8b902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9460d0c-6a72-4602-9cda-88cfef8b902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dd6a53-cca4-4ab9-8148-61601781a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Volume ccad09de-c007-4234-94ef-09c103d6d141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccad09de-c007-4234-94ef-09c103d6d141', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.553s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393605316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7144a9c3-12f2-46fc-97e1-162a2a12f138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:51Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume 7144a9c3-12f2-46fc-97e1-162a2a12f138 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f60c3c-157e-46b6-b5ad-1155f2494f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb99d562-a836-48e9-a7ff-2c8fc8e03bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Volume volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 (8dc2df8b-1333-441c-98fe-e0625a03a6f5): created successfully Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb99d562-a836-48e9-a7ff-2c8fc8e03bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (46a35939-f197-4e8c-823f-b07821ac6af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ebe71d7e-0a69-48ae-8856-1ee002c65a3d tempest-VolumeDependencyTests-946759678 None] Created volume successfully. Feb 27 02:13:52 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 1073741824 Feb 27 02:13:52 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (24e7ac14-3c66-4420-a3f3-a34fb423d89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c6b73-afc6-404e-af26-218d4b5e17f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c6b73-afc6-404e-af26-218d4b5e17f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731020534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07673f2e-0980-4106-9e42-51448226573f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2b0793-568a-458a-bdb8-c09dd696b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2b0793-568a-458a-bdb8-c09dd696b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad700cd-14a0-4034-9009-42293837cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad700cd-14a0-4034-9009-42293837cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07673f2e-0980-4106-9e42-51448226573f', 'volume_name': 'volume-07673f2e-0980-4106-9e42-51448226573f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad9c082-b1fc-43de-851e-7f0c0f3119b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad9c082-b1fc-43de-851e-7f0c0f3119b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59066723-0b42-4e7a-9bdb-78212e69b4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:52 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Volume 07673f2e-0980-4106-9e42-51448226573f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07673f2e-0980-4106-9e42-51448226573f', 'volume_size': 1} Feb 27 02:13:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 1073741824" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:53 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 Feb 27 02:13:53 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138" returned: 0 in 0.480s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.021s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1180167254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92d3c5f-4d82-40bc-a0ce-96e3c7a12164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Creating volume d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:53 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73adc4d9-1dcf-49d2-abf5-03eedf671cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7144a9c3-12f2-46fc-97e1-162a2a12f138', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc040c23-3b8a-4a49-afa1-2612bba552c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:53 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 1073741824 Feb 27 02:13:53 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:53 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 (7144a9c3-12f2-46fc-97e1-162a2a12f138): created successfully Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc040c23-3b8a-4a49-afa1-2612bba552c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:53 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (099f6988-e403-4cd9-8362-1edc7a8a0889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-f3043148-4299-4e8c-872c-042b00493e39 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:13:54 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 1073741824" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:54 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 Feb 27 02:13:54 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:54 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=86,cinder:INSERT=23,cinder:UPDATE=117,cinder:DELETE=9 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" returned: 0 in 0.608s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=85,cinder:INSERT=34,cinder:UPDATE=114,cinder:DELETE=8 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315861367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff47407-ef22-4cb8-ae04-7d019af677bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Creating volume 4ff47407-ef22-4cb8-ae04-7d019af677bf {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:54 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:54 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf 1073741824 Feb 27 02:13:54 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (c2eb881c-7fb6-471d-92c4-cd4738bc28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc062d00-6594-4ff1-a292-379724a5bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc062d00-6594-4ff1-a292-379724a5bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893037693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8965fb9-b20a-4e9d-a7fa-b2a756e7842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58d4305-5b11-414e-b2a4-c6054e178615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58d4305-5b11-414e-b2a4-c6054e178615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18e3fb2-9cb8-4332-bd01-47b8fbcfabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:54 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18e3fb2-9cb8-4332-bd01-47b8fbcfabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8965fb9-b20a-4e9d-a7fa-b2a756e7842c', 'volume_name': 'volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71d672-9b41-4bce-a177-b87008e46b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71d672-9b41-4bce-a177-b87008e46b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4efa210-a083-4e3a-844a-700e64588913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume b8965fb9-b20a-4e9d-a7fa-b2a756e7842c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c', 'volume_size': 1} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3c5dc1-04b7-4038-8b02-b30ce469f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0618583b-7576-4cfe-a0f4-ff5dc9d6b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Volume volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 (d92d3c5f-4d82-40bc-a0ce-96e3c7a12164): created successfully Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0618583b-7576-4cfe-a0f4-ff5dc9d6b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (28bbc68f-5dc1-4675-a79d-d6f4b2680d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-cd54275f-dafe-4844-8f42-6800c9b007c3 tempest-CreateVolumesFromImageTest-1089174629 None] Created volume successfully. Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (d0b389c4-61d2-4d7f-ba6b-6460782ac02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7590484-ef64-4328-a0c7-89a276eadbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7590484-ef64-4328-a0c7-89a276eadbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-158129458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6646198-2908-44c9-9dba-1fd0d53d9690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b47fda0-25c2-4759-a40c-230d2a625ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b47fda0-25c2-4759-a40c-230d2a625ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb38e7f-87b7-4cc8-9f52-16da98b8c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb38e7f-87b7-4cc8-9f52-16da98b8c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6646198-2908-44c9-9dba-1fd0d53d9690', 'volume_name': 'volume-a6646198-2908-44c9-9dba-1fd0d53d9690', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887b702-fe2c-4dc2-9159-04b81287df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887b702-fe2c-4dc2-9159-04b81287df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b510d9c-1032-453c-8a86-2e00a4a011bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume a6646198-2908-44c9-9dba-1fd0d53d9690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6646198-2908-44c9-9dba-1fd0d53d9690', 'volume_size': 1} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (36b45d96-0784-44c7-80f2-ef0d51f0a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0612e3af-2385-4eae-837f-90ebfe88bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0612e3af-2385-4eae-837f-90ebfe88bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65452349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bde7ae-1615-40c2-bc6d-5a5863399188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bde7ae-1615-40c2-bc6d-5a5863399188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514ae578-5f02-4d38-9bd9-e2c8e834ec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514ae578-5f02-4d38-9bd9-e2c8e834ec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b', 'volume_name': 'volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9305eb2-444f-4d0d-8f2b-e5dea83367ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9305eb2-444f-4d0d-8f2b-e5dea83367ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498f0f01-5069-4ec0-b8a7-0ebcdbf63638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b', 'volume_size': 1} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (9ba8657c-fb28-489c-8867-be0155dbc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eba5f8-f62f-47b0-b3e3-928c41dc97b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eba5f8-f62f-47b0-b3e3-928c41dc97b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196716196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3400629-bec8-4f44-92fd-1fc16e11de05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671ab39b-e529-4c46-bd3e-170ebd6c6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671ab39b-e529-4c46-bd3e-170ebd6c6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33865fb-5cac-407b-8a1e-c79e34c73dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33865fb-5cac-407b-8a1e-c79e34c73dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3400629-bec8-4f44-92fd-1fc16e11de05', 'volume_name': 'volume-a3400629-bec8-4f44-92fd-1fc16e11de05', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00253477-38e5-4409-9907-6b445e725ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00253477-38e5-4409-9907-6b445e725ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eebc14-988e-4bf9-96b5-fae72e76f460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume a3400629-bec8-4f44-92fd-1fc16e11de05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3400629-bec8-4f44-92fd-1fc16e11de05', 'volume_size': 1} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:55 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf 1073741824" returned: 0 in 0.754s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:55 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf Feb 27 02:13:55 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (e85eef8b-c1fd-4014-8b75-7281422c601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392497f-af1d-4298-aafe-109f2838d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2392497f-af1d-4298-aafe-109f2838d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248312706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2492d9b-7c2c-4de9-964e-724f1235560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:56Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e04d93-ba02-4153-87c5-c6ff7014edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e04d93-ba02-4153-87c5-c6ff7014edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7882ce-c940-488b-8c75-567069f93b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7882ce-c940-488b-8c75-567069f93b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2492d9b-7c2c-4de9-964e-724f1235560c', 'volume_name': 'volume-b2492d9b-7c2c-4de9-964e-724f1235560c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c14447-ae6f-45ae-930f-a0ff1876ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c14447-ae6f-45ae-930f-a0ff1876ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4278821-4304-47c8-bf16-6e904db0e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:55 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume b2492d9b-7c2c-4de9-964e-724f1235560c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2492d9b-7c2c-4de9-964e-724f1235560c', 'volume_size': 1} Feb 27 02:13:55 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:56 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580642510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9784dcc6-5656-457b-b0c6-3680195b5cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Creating volume 9784dcc6-5656-457b-b0c6-3680195b5cf3 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:56 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7eabd6-8b12-4af0-bcaa-274f5c1a0667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff47407-ef22-4cb8-ae04-7d019af677bf', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7d136-3bd4-424f-8ec3-57257b3d1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:56 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 1073741824 Feb 27 02:13:56 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:56 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Volume volume-4ff47407-ef22-4cb8-ae04-7d019af677bf (4ff47407-ef22-4cb8-ae04-7d019af677bf): created successfully Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7d136-3bd4-424f-8ec3-57257b3d1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (1bdae17b-dded-4e8a-a7dd-7e7a1900704c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:56 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b09268ca-34ee-4510-9a74-451d2510f98e tempest-CreateVolumesFromImageTest-1089174629 None] Created volume successfully. Feb 27 02:13:56 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 1073741824" returned: 0 in 0.564s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:56 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:56 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 Feb 27 02:13:56 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:57 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3" returned: 0 in 0.433s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.720s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012511552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccad09de-c007-4234-94ef-09c103d6d141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:52Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Creating volume ccad09de-c007-4234-94ef-09c103d6d141 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:57 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6789040-f9b5-4f14-9fba-91c58de228e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9784dcc6-5656-457b-b0c6-3680195b5cf3', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dc0571-1d0f-41cc-b518-6675c79f7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:57 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 1073741824 Feb 27 02:13:57 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:57 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Volume volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 (9784dcc6-5656-457b-b0c6-3680195b5cf3): created successfully Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dc0571-1d0f-41cc-b518-6675c79f7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (3bacedf1-3619-40c8-9ca1-93ec826a9317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:57 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ca805f4c-da13-418c-b133-556cc0c89080 tempest-CreateVolumesFromImageTest-1089174629 None] Created volume successfully. Feb 27 02:13:57 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 1073741824" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:57 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:57 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 Feb 27 02:13:57 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:58 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.532s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731020534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07673f2e-0980-4106-9e42-51448226573f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5e9eaa01f134472b71902b04c069a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:53Z,use_quota=True,user_id='8a78de502d8942d1a358bb12a4f6a5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Creating volume 07673f2e-0980-4106-9e42-51448226573f {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:13:58 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dd6a53-cca4-4ab9-8148-61601781a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccad09de-c007-4234-94ef-09c103d6d141', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d277412b-404f-4c26-9393-84126fc5687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:58 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f 1073741824 Feb 27 02:13:58 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:58 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Volume volume-ccad09de-c007-4234-94ef-09c103d6d141 (ccad09de-c007-4234-94ef-09c103d6d141): created successfully Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d277412b-404f-4c26-9393-84126fc5687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (d42c3356-c871-4b10-833c-6c300141e847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:58 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a85e5055-6e92-474b-97ca-2124efd7a6d4 tempest-CreateVolumesFromImageTest-1089174629 None] Created volume successfully. Feb 27 02:13:58 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f 1073741824" returned: 0 in 0.679s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:58 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:58 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f Feb 27 02:13:58 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:13:59 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f" returned: 0 in 0.517s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.891s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59066723-0b42-4e7a-9bdb-78212e69b4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07673f2e-0980-4106-9e42-51448226573f', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefd24d-9e6d-41b5-8c8d-40d189ea11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Creating offline snapshot fd204ca7-58a7-456e-9b57-ce74f58d5d96 of volume 8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:13:59 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Volume volume-07673f2e-0980-4106-9e42-51448226573f (07673f2e-0980-4106-9e42-51448226573f): created successfully Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefd24d-9e6d-41b5-8c8d-40d189ea11a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Flow 'volume_create_manager' (24e7ac14-3c66-4420-a3f3-a34fb423d89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd326e9-7d81-424c-b0de-303f21cb0fb7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:13:59 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:13:59 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b6330274-fcb2-4140-ac4b-805c73fc918a tempest-CreateVolumesFromImageTest-1089174629 None] Created volume successfully. Feb 27 02:13:59 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:13:59 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.537s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 1G Feb 27 02:14:00 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-07673f2e-0980-4106-9e42-51448226573f-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-07673f2e-0980-4106-9e42-51448226573f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-quobyte-07673f2e-0980-4106-9e42-51448226573f" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-07673f2e-0980-4106-9e42-51448226573f" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da925f-ec51-4348-b17a-ece704fea9de]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f Feb 27 02:14:00 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 1G" returned: 0 in 0.515s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:00 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:00 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f" returned: 0 in 0.624s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:00 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:00 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f Feb 27 02:14:00 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:01 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.558s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:01 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 is being set with open permissions: ugo+rw Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:01 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:01 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-07673f2e-0980-4106-9e42-51448226573f" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-07673f2e-0980-4106-9e42-51448226573f" released by "delete_volume" :: held 1.140s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Created reservations ['cee68c8f-789f-4ac0-8df9-9172148a8148', 'b9c5ddb3-141d-41cd-a9ba-d003984727cf', 'bac48e48-0a3b-48f8-ac32-317c8ff6c277', '4527c2c7-d52b-47cb-a734-f87f0e5811cf'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:01 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:01 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.506s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:01 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:01 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info Feb 27 02:14:01 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.499s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:02 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Deleted volume successfully. Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e7b3091c-8f58-48e3-9e6d-3c00a4eff2f8 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-07673f2e-0980-4106-9e42-51448226573f-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:02 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info" returned: 0 in 0.499s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info is being set with open permissions: ugo+rw Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info Feb 27 02:14:02 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-ccad09de-c007-4234-94ef-09c103d6d141-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-ccad09de-c007-4234-94ef-09c103d6d141-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-quobyte-ccad09de-c007-4234-94ef-09c103d6d141" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-ccad09de-c007-4234-94ef-09c103d6d141" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49aefda-afb4-4832-adc7-6479cb2bc1f9]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 Feb 27 02:14:02 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.info" returned: 0 in 0.500s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.673s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893037693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8965fb9-b20a-4e9d-a7fa-b2a756e7842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume b8965fb9-b20a-4e9d-a7fa-b2a756e7842c {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:02 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:02 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:02 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c 1073741824 Feb 27 02:14:02 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:02 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-7080b4bb-51bb-43be-a609-cfae73910b60 tempest-VolumeDependencyTests-946759678 None] Create snapshot completed successfully Feb 27 02:14:03 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141" returned: 0 in 0.536s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:03 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141 Feb 27 02:14:03 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c 1073741824" returned: 0 in 0.600s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:03 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c Feb 27 02:14:03 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (a5e3f6a5-9993-498f-87b9-a0b33b249d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c75908-1250-4be5-91c1-fe02779088c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c75908-1250-4be5-91c1-fe02779088c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-384048214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f068010b-f0b7-42b5-9d1c-70d12c44a960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd204ca7-58a7-456e-9b57-ce74f58d5d96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:03Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eda51aa-df7f-491e-82ad-ada1713d7085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eda51aa-df7f-491e-82ad-ada1713d7085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43643d2d-ccbf-438b-ae8e-594096d170a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43643d2d-ccbf-438b-ae8e-594096d170a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f068010b-f0b7-42b5-9d1c-70d12c44a960', 'volume_name': 'volume-f068010b-f0b7-42b5-9d1c-70d12c44a960', 'volume_size': 1, 'snapshot_id': 'fd204ca7-58a7-456e-9b57-ce74f58d5d96'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6154d4aa-84d9-42e5-8ba2-0e5bf1de68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6154d4aa-84d9-42e5-8ba2-0e5bf1de68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313a062b-c98d-42ce-a151-7912afa1a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Volume f068010b-f0b7-42b5-9d1c-70d12c44a960: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f068010b-f0b7-42b5-9d1c-70d12c44a960', 'volume_size': 1, 'snapshot_id': 'fd204ca7-58a7-456e-9b57-ce74f58d5d96'} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:03 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ccad09de-c007-4234-94ef-09c103d6d141" returned: 0 in 0.572s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-ccad09de-c007-4234-94ef-09c103d6d141" released by "delete_volume" :: held 1.130s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Created reservations ['ebf12204-0de8-4ea5-866e-00c9292ff78b', 'fa5ee002-8aa1-43df-877d-7e1ea9ce87f5', '81709d58-5998-45e0-a0e3-00e6f9563c59', 'ff81c663-5281-4a2e-a668-fd049ce0f5a6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:03 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:03 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.647s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-158129458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6646198-2908-44c9-9dba-1fd0d53d9690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume a6646198-2908-44c9-9dba-1fd0d53d9690 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:03 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4efa210-a083-4e3a-844a-700e64588913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7364c4-d62a-4b4b-8d5c-fd077c70f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:03 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c (b8965fb9-b20a-4e9d-a7fa-b2a756e7842c): created successfully Feb 27 02:14:03 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 1073741824 Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7364c4-d62a-4b4b-8d5c-fd077c70f609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:03 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:03 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (c2eb881c-7fb6-471d-92c4-cd4738bc28ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:03 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-00f9fb71-d304-493f-b234-5137d104baee tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:14:04 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.511s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:04 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Deleted volume successfully. Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be372501-d023-43bc-881d-5c2163089343 tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-ccad09de-c007-4234-94ef-09c103d6d141-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:04 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 1073741824" returned: 0 in 0.694s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-9784dcc6-5656-457b-b0c6-3680195b5cf3-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-9784dcc6-5656-457b-b0c6-3680195b5cf3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:04 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 Feb 27 02:14:04 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-quobyte-9784dcc6-5656-457b-b0c6-3680195b5cf3" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-9784dcc6-5656-457b-b0c6-3680195b5cf3" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a56834b-2b3c-4e41-9c20-76b2a09b80ab]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:04 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:04 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 Feb 27 02:14:04 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:05 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690" returned: 0 in 0.492s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.643s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65452349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:05 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b 1073741824 Feb 27 02:14:05 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b510d9c-1032-453c-8a86-2e00a4a011bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6646198-2908-44c9-9dba-1fd0d53d9690', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39714b0c-2a64-412a-9503-5ce247f578aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:05 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-a6646198-2908-44c9-9dba-1fd0d53d9690 (a6646198-2908-44c9-9dba-1fd0d53d9690): created successfully Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39714b0c-2a64-412a-9503-5ce247f578aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (d0b389c4-61d2-4d7f-ba6b-6460782ac02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:05 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-cef1faf9-3b7d-4b14-aaed-6fc4f2d5fa63 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:14:05 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3" returned: 0 in 0.594s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3 Feb 27 02:14:05 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:05 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b 1073741824" returned: 0 in 0.575s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b Feb 27 02:14:05 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:05 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-9784dcc6-5656-457b-b0c6-3680195b5cf3" returned: 0 in 0.548s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-9784dcc6-5656-457b-b0c6-3680195b5cf3" released by "delete_volume" :: held 1.176s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Created reservations ['0f7bffd7-e5d3-422b-8702-26145876ee0a', '7ab243e2-f6c4-44a9-a6d5-9989985f42f3', 'c671d97d-8c77-4369-90b0-0dd37a8e210e', 'eb554d84-40eb-4841-8372-3981b4b448b1'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:05 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:05 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:05 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:06 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" returned: 0 in 0.460s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.584s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196716196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3400629-bec8-4f44-92fd-1fc16e11de05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:55Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume a3400629-bec8-4f44-92fd-1fc16e11de05 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:06 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498f0f01-5069-4ec0-b8a7-0ebcdbf63638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cb5541-f1c5-480f-beab-c64fa9979ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:06 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b (f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b): created successfully Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cb5541-f1c5-480f-beab-c64fa9979ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:06 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 1073741824 Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (36b45d96-0784-44c7-80f2-ef0d51f0a53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:06 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:06 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-74de3a1e-c6a2-478b-9b64-3bd8b8b74dad tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:14:06 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.496s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:06 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Deleted volume successfully. Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ca93209d-151e-4f70-b893-322e370d3abb tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-9784dcc6-5656-457b-b0c6-3680195b5cf3-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:06 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 1073741824" returned: 0 in 0.597s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:06 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 Feb 27 02:14:06 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-4ff47407-ef22-4cb8-ae04-7d019af677bf-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-4ff47407-ef22-4cb8-ae04-7d019af677bf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-quobyte-4ff47407-ef22-4cb8-ae04-7d019af677bf" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-4ff47407-ef22-4cb8-ae04-7d019af677bf" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f34fa-5be3-4cd3-a474-1d23917c9be3]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:06 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:06 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf Feb 27 02:14:06 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:07 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05" returned: 0 in 0.464s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.477s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248312706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2492d9b-7c2c-4de9-964e-724f1235560c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9e9acab6c8469f94a8f73cbf4c1e99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:13:56Z,use_quota=True,user_id='516cf47a5e684cb0bc9e137a18d99da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Creating volume b2492d9b-7c2c-4de9-964e-724f1235560c {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:07 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eebc14-988e-4bf9-96b5-fae72e76f460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3400629-bec8-4f44-92fd-1fc16e11de05', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4264419-b309-48d1-8a40-7376c48b1412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:07 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-a3400629-bec8-4f44-92fd-1fc16e11de05 (a3400629-bec8-4f44-92fd-1fc16e11de05): created successfully Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4264419-b309-48d1-8a40-7376c48b1412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:07 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c 1073741824 Feb 27 02:14:07 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (9ba8657c-fb28-489c-8867-be0155dbc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:07 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1ddcce4a-4488-4607-99d7-500c2160ba42 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:14:07 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf" returned: 0 in 0.621s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:07 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf Feb 27 02:14:07 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:07 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c 1073741824" returned: 0 in 0.633s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:07 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:07 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c Feb 27 02:14:07 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-4ff47407-ef22-4cb8-ae04-7d019af677bf" returned: 0 in 0.560s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-4ff47407-ef22-4cb8-ae04-7d019af677bf" released by "delete_volume" :: held 1.210s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Created reservations ['9e8e5085-0166-4a69-8fd0-34facbf74db3', 'db638951-8c67-415c-9ea2-0b82a7f4d7e9', 'fa78f842-07bf-40ae-990e-3009fd1b38cc', '93a884e8-a62e-4458-a388-9a9a4fbc7681'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:08 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:08 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c" returned: 0 in 0.522s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.976s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96-f068010b-f0b7-42b5-9d1c-70d12c44a960" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4278821-4304-47c8-bf16-6e904db0e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2492d9b-7c2c-4de9-964e-724f1235560c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71507c49-93f7-4385-90e2-c2888f3d2273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96-f068010b-f0b7-42b5-9d1c-70d12c44a960" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Creating volume f068010b-f0b7-42b5-9d1c-70d12c44a960 from snapshot fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:08 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Volume volume-b2492d9b-7c2c-4de9-964e-724f1235560c (b2492d9b-7c2c-4de9-964e-724f1235560c): created successfully Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71507c49-93f7-4385-90e2-c2888f3d2273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Flow 'volume_create_manager' (e85eef8b-c1fd-4014-8b75-7281422c601e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-64767ab7-61bd-4987-a0df-d4abca907270 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created volume successfully. Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] snapshot: fd204ca7-58a7-456e-9b57-ce74f58d5d96, volume: f068010b-f0b7-42b5-9d1c-70d12c44a960, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077aaa2-234a-4991-8a89-89c97126d88a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:08 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Flow 'volume_create_manager' (782deeef-63ae-4eba-8210-8bf9e04d0c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b1e7ec-61cc-47f3-b478-8385eec71ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:08 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:08 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b1e7ec-61cc-47f3-b478-8385eec71ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513064037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19caee67-2f9b-4759-b721-963f2d68e1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7f42d432b8434180f18656d386bfda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:09Z,use_quota=True,user_id='9ae9670db4fd468ca948e393f77ac065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254ecf50-aa34-4196-8b77-53deca197db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254ecf50-aa34-4196-8b77-53deca197db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd417f-065b-4c75-a853-4cb3e48fcca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbd417f-065b-4c75-a853-4cb3e48fcca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19caee67-2f9b-4759-b721-963f2d68e1b7', 'volume_name': 'volume-19caee67-2f9b-4759-b721-963f2d68e1b7', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d26ec4-efd4-4c91-bac2-cf83f9e06562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d26ec4-efd4-4c91-bac2-cf83f9e06562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0506a095-dd36-490a-b2ad-95a4f1b5a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:08 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Volume 19caee67-2f9b-4759-b721-963f2d68e1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19caee67-2f9b-4759-b721-963f2d68e1b7', 'volume_size': 1} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:08 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Deleted volume successfully. Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-500dfc11-4abe-48f1-b096-e5379a6c00af tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-4ff47407-ef22-4cb8-ae04-7d019af677bf-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-b2492d9b-7c2c-4de9-964e-724f1235560c-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-b2492d9b-7c2c-4de9-964e-724f1235560c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-b2492d9b-7c2c-4de9-964e-724f1235560c" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-b2492d9b-7c2c-4de9-964e-724f1235560c" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157cdf6-6f77-4650-a6af-c1c5063546e4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:08 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:08 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c Feb 27 02:14:08 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "cinder-quobyte-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[34722bf5-e32f-408e-84b5-4b574efb3172]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.588s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:09 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 Feb 27 02:14:09 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[acabb2c0-2d0d-4511-8ad9-f9d1fdfbda4b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:14:09 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c" returned: 0 in 0.543s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c Feb 27 02:14:09 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" returned: 0 in 0.488s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164 Feb 27 02:14:09 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.515s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 Feb 27 02:14:09 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:09 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b2492d9b-7c2c-4de9-964e-724f1235560c" returned: 0 in 0.410s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-b2492d9b-7c2c-4de9-964e-724f1235560c" released by "delete_volume" :: held 0.985s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['501d1f15-9fa2-46ad-b83c-d1a3232b4d1e', '0a40915b-4201-4ac8-adb3-0c4919d678fe', '40eaf363-1db2-418d-98f8-d85d76370521', '3e8adc33-9867-4d92-8b45-2c585e4b3dbf'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:09 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:09 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:09 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:10 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" returned: 0 in 0.490s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-quobyte-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164" released by "delete_volume" :: held 1.010s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Created reservations ['ae779d0a-5218-4095-8cc5-42436bec79d5', '3fdd9395-f54d-40dc-b5ba-a5a45fc06c79', 'b16237e7-7d63-4fb5-a8d0-27e8ff200fe5', '6be7b86e-ccd4-402d-9291-268a79b2bf27'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:10 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:10 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:10 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.058s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:10 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:10 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-d0242683-f645-440c-b7e8-d3d8f8cca890 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-b2492d9b-7c2c-4de9-964e-724f1235560c-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-a3400629-bec8-4f44-92fd-1fc16e11de05-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-a3400629-bec8-4f44-92fd-1fc16e11de05-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-a3400629-bec8-4f44-92fd-1fc16e11de05" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-a3400629-bec8-4f44-92fd-1fc16e11de05" acquired by "delete_volume" :: waited 0.027s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd5446-5211-460a-9343-c79e08b81cff]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:11 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 Feb 27 02:14:11 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:11 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.725s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:11 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Deleted volume successfully. Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5e8515f9-98cd-4ead-9744-dbb17567d65a tempest-CreateVolumesFromImageTest-1089174629 None] Lock "cinder-d92d3c5f-4d82-40bc-a0ce-96e3c7a12164-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:11 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:11 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960" returned: 0 in 2.274s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25f7048-9e40-463c-ad7d-6fa14658ddb7]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:14:12 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:12 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05" returned: 0 in 1.013s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05 Feb 27 02:14:12 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:12 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.671s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:14:12 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Converted 1024.00 MB image at 450.06 MB/s Feb 27 02:14:12 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 is being set with open permissions: ugo+rw Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 Feb 27 02:14:12 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:12 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a3400629-bec8-4f44-92fd-1fc16e11de05" returned: 0 in 0.468s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-a3400629-bec8-4f44-92fd-1fc16e11de05" released by "delete_volume" :: held 1.526s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['3965c0fa-88c7-4fc9-836b-8a82c10b5232', '81d9ddc8-49d0-4bdc-b1b4-57dce6d7de1d', 'b8311665-0a3b-4d32-9768-8a778b88ee25', '4d4c8653-e717-47f2-aeb4-642e8de1e25f'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:12 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:12 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:12 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960" returned: 0 in 0.491s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" released by "_copy_volume_from_snapshot" :: held 4.640s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96-f068010b-f0b7-42b5-9d1c-70d12c44a960" released by "_create_volume_from_snapshot" :: held 4.686s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.714s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.439s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1513064037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19caee67-2f9b-4759-b721-963f2d68e1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7f42d432b8434180f18656d386bfda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:09Z,use_quota=True,user_id='9ae9670db4fd468ca948e393f77ac065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Creating volume 19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:13 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 1073741824 Feb 27 02:14:13 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313a062b-c98d-42ce-a151-7912afa1a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f068010b-f0b7-42b5-9d1c-70d12c44a960', 'volume_size': 1, 'snapshot_id': 'fd204ca7-58a7-456e-9b57-ce74f58d5d96'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc631878-af20-41fc-82bc-1658132cc161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Volume volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 (f068010b-f0b7-42b5-9d1c-70d12c44a960): created successfully Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc631878-af20-41fc-82bc-1658132cc161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (a5e3f6a5-9993-498f-87b9-a0b33b249d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-433e7cfd-8331-4864-a241-6d51f1161c39 tempest-VolumeDependencyTests-946759678 None] Created volume successfully. Feb 27 02:14:13 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.459s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:13 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-c21cd52c-371a-44ab-b90a-9803186b13c7 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-a3400629-bec8-4f44-92fd-1fc16e11de05-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:13 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:13 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (db06a62c-70cc-44ff-a567-62c93468231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f66b4e-2e52-43dd-9fdd-b9fafcde433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f66b4e-2e52-43dd-9fdd-b9fafcde433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793754747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3bc209-e06d-4990-8673-f5710be50396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:13Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf9635a-bb5b-46a7-b0e2-ff1fc2fc39d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf9635a-bb5b-46a7-b0e2-ff1fc2fc39d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d419fa-c477-4c39-a74a-8438946153d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d419fa-c477-4c39-a74a-8438946153d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3bc209-e06d-4990-8673-f5710be50396', 'volume_name': 'volume-ae3bc209-e06d-4990-8673-f5710be50396', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab32a1a-5ab8-4d5e-8aff-607565bf2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab32a1a-5ab8-4d5e-8aff-607565bf2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d70f7-5bfa-4c35-a06a-f208ef37b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:13 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume ae3bc209-e06d-4990-8673-f5710be50396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3bc209-e06d-4990-8673-f5710be50396', 'volume_size': 1} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb0a0c3-a294-44aa-9496-9c84f9577d36]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b Feb 27 02:14:13 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 1073741824" returned: 0 in 0.535s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:13 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:13 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:13 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.459s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-fd204ca7-58a7-456e-9b57-ce74f58d5d96-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-fd204ca7-58a7-456e-9b57-ce74f58d5d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Deleting offline snapshot fd204ca7-58a7-456e-9b57-ce74f58d5d96 of volume 8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] snapshot_file for this snap is: volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[00467753-901a-4f63-a54c-8738af2f2035]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" returned: 0 in 0.557s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.464s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:14 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b Feb 27 02:14:14 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-793754747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3bc209-e06d-4990-8673-f5710be50396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:13Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:14 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0506a095-dd36-490a-b2ad-95a4f1b5a74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19caee67-2f9b-4759-b721-963f2d68e1b7', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:14 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 1073741824 Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d8ed87-42d8-45c8-ba40-f3a90fccb4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:14 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Volume volume-19caee67-2f9b-4759-b721-963f2d68e1b7 (19caee67-2f9b-4759-b721-963f2d68e1b7): created successfully Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d8ed87-42d8-45c8-ba40-f3a90fccb4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:14 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:14 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Flow 'volume_create_manager' (782deeef-63ae-4eba-8210-8bf9e04d0c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:14 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-20b3c4cc-5265-45cc-9fa9-028953a3f0b5 tempest-SnapshotDependencyTests-1892661838 None] Created volume successfully. Feb 27 02:14:14 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" returned: 0 in 0.456s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b" released by "delete_volume" :: held 1.035s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:14 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.488s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fdb272-e953-4edb-95a1-6f4f6798f742]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['8f69b393-0f5d-4f48-bfd6-8654436d535b', 'c691422c-d0dc-42d5-8d71-e9a4a4e0cc9d', '8c2bbc56-c43b-4b95-b19b-1d05c718226f', '4577540f-172c-4c1c-ac05-39d63fd07932'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:14 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 1073741824" returned: 0 in 0.525s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:14:14 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:14 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:14 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:14 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 Feb 27 02:14:14 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.392s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-4a047cd0-754c-44a1-bb83-ed5b74c07dab tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-f55d8b0d-7cc9-4123-b3eb-202aaba8bf7b-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:15 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.491s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:15 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396" returned: 0 in 0.429s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9d70f7-5bfa-4c35-a06a-f208ef37b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3bc209-e06d-4990-8673-f5710be50396', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee60683e-3cc8-4d71-918c-3ecb81d8e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:15 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-ae3bc209-e06d-4990-8673-f5710be50396 (ae3bc209-e06d-4990-8673-f5710be50396): created successfully Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee60683e-3cc8-4d71-918c-3ecb81d8e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (db06a62c-70cc-44ff-a567-62c93468231a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:15 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1cf3e061-c4d7-4517-b6f1-fafffd9851ea tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Creating offline snapshot 82ed7b59-230d-4736-932e-1a686b466dcc of volume 19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81baa0a-84d0-43b3-899d-e6826728393a]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:15 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-a6646198-2908-44c9-9dba-1fd0d53d9690-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-a6646198-2908-44c9-9dba-1fd0d53d9690-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-a6646198-2908-44c9-9dba-1fd0d53d9690" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-a6646198-2908-44c9-9dba-1fd0d53d9690" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:15 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.577s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff7752-b6ff-4997-ab9c-6b1d98c7d8ea]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96 Feb 27 02:14:15 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 Feb 27 02:14:15 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:15 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.542s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:15 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:15 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc 1G Feb 27 02:14:15 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5.fd204ca7-58a7-456e-9b57-ce74f58d5d96" returned: 0 in 0.408s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-fd204ca7-58a7-456e-9b57-ce74f58d5d96" released by "_delete_snapshot" :: held 2.022s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" released by "delete_snapshot" :: held 2.034s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Created reservations ['b1b06081-738f-4fb4-95c7-c648b14cfe31', 'b4f6fa09-9c9f-4ebd-856c-05ce65f42799', '8db1b984-cef8-42f9-be13-b3e82dec269f', '90aeb684-42c4-44cf-8c74-1fd7e37f9908'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:16 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690 Feb 27 02:14:16 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Delete snapshot completed successfully. Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-7c3d9dc3-cfe6-48d0-a170-b5c2271a9345 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-fd204ca7-58a7-456e-9b57-ce74f58d5d96-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:16 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc 1G" returned: 0 in 0.509s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caee67-2f9b-4759-b721-963f2d68e1b7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caee67-2f9b-4759-b721-963f2d68e1b7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:16 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-a6646198-2908-44c9-9dba-1fd0d53d9690" returned: 0 in 0.408s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-a6646198-2908-44c9-9dba-1fd0d53d9690" released by "delete_volume" :: held 0.945s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['d5ffb40a-f892-4696-a542-1aa112be2ca6', '670a04e9-2f04-4f52-8023-ac7d2bebf025', '362fce2e-aadf-4120-826e-473a252014a6', 'e2b7545c-83ee-44fa-b2fe-908b04a5e33b'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19caee67-2f9b-4759-b721-963f2d68e1b7 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.431s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:16 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc is being set with open permissions: ugo+rw Feb 27 02:14:16 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:16 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:16 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:16 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:16 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.385s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.409s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:17 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-1f7e1443-0784-4af2-b603-5c14c3a3aa1a tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-a6646198-2908-44c9-9dba-1fd0d53d9690-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:17 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info Feb 27 02:14:17 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-8dc2df8b-1333-441c-98fe-e0625a03a6f5-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "cinder-8dc2df8b-1333-441c-98fe-e0625a03a6f5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3c1fb-30f8-44ed-a66a-4214fe090e0d]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:14:17 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info" returned: 0 in 0.416s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info is being set with open permissions: ugo+rw Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info Feb 27 02:14:17 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f7adc3-fb56-4431-90fd-d9b944354dd1]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.542s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:17 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:17 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5 Feb 27 02:14:17 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:17 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c Feb 27 02:14:17 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.info" returned: 0 in 0.406s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.308s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating offline snapshot 976bc81b-2765-48e7-8799-dd00045d45e0 of volume ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[d148b1b1-0c1c-453d-aa5f-453a994eed1c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-215c7943-ba45-4101-bf9e-57ad68eb4c30 tempest-SnapshotDependencyTests-1892661838 None] Create snapshot completed successfully Feb 27 02:14:18 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 Feb 27 02:14:18 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" returned: 0 in 0.463s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8dc2df8b-1333-441c-98fe-e0625a03a6f5" returned: 0 in 0.426s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-8dc2df8b-1333-441c-98fe-e0625a03a6f5" released by "delete_volume" :: held 1.000s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:18 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c Feb 27 02:14:18 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Created reservations ['b7e00749-52c5-45bf-902f-99087a0e1013', '0b900463-ff7e-4df8-9675-8b85c9c55e72', 'db2c001c-85af-4836-98f1-45a400c0fd68', '8cc9b67b-f4e3-481b-b3c5-4875d8eda67c'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:18 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396" returned: 0 in 0.603s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:18 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 1G Feb 27 02:14:18 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:18 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Flow 'volume_create_manager' (91f43f76-aa15-41e6-9514-6a1cfd3ac6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb91505-c2b1-42e4-bea7-d2d284da2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb91505-c2b1-42e4-bea7-d2d284da2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8322f6cf-f933-418e-b7b3-6e31d2850c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7f42d432b8434180f18656d386bfda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82ed7b59-230d-4736-932e-1a686b466dcc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:19Z,use_quota=True,user_id='9ae9670db4fd468ca948e393f77ac065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc221f97-64b8-44cb-9329-9091da00f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc221f97-64b8-44cb-9329-9091da00f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a7762-aead-4124-9263-3edc601a2d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356a7762-aead-4124-9263-3edc601a2d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8322f6cf-f933-418e-b7b3-6e31d2850c3a', 'volume_name': 'volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a', 'volume_size': 1, 'snapshot_id': '82ed7b59-230d-4736-932e-1a686b466dcc'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8598d544-8b7d-4a92-b9f0-c3cc3a1ec5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8598d544-8b7d-4a92-b9f0-c3cc3a1ec5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333023b2-f52a-4292-a215-e924d01f58bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:18 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Volume 8322f6cf-f933-418e-b7b3-6e31d2850c3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a', 'volume_size': 1, 'snapshot_id': '82ed7b59-230d-4736-932e-1a686b466dcc'} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c" released by "delete_volume" :: held 1.013s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['fdbf3ed0-25da-46df-9fcc-b76c2a0c4e31', 'b8f747d9-a580-4bc1-a7e7-a3e315408b10', 'be1ad953-f046-48f9-b5a9-3421b32fba0e', '1ae2b623-4948-4629-a3d3-fb480ad4832a'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:18 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:18 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.505s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Deleted volume successfully. Feb 27 02:14:19 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:19 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5ec20867-5c32-410e-a87c-fb4f795b555b tempest-VolumeDependencyTests-946759678 None] Lock "cinder-8dc2df8b-1333-441c-98fe-e0625a03a6f5-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:19 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 1G" returned: 0 in 0.541s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3bc209-e06d-4990-8673-f5710be50396 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:19 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3bc209-e06d-4990-8673-f5710be50396 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 Feb 27 02:14:19 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.392s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:19 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-79cbb41a-2f7d-456a-8475-9ed88d31611f tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-b8965fb9-b20a-4e9d-a7fa-b2a756e7842c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:19 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (651e4354-5d71-4e3a-84d8-095509ac4961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca52ed-79a2-4e57-8234-b81a7d528a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae3bc209-e06d-4990-8673-f5710be50396 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0" returned: 0 in 0.519s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:19 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 is being set with open permissions: ugo+rw Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:19 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 Feb 27 02:14:19 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca52ed-79a2-4e57-8234-b81a7d528a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-977577729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a850e7-c845-4d9e-a939-843e977549f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:20Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32c517-0180-48fe-ba34-fe7928ff0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32c517-0180-48fe-ba34-fe7928ff0c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865b9130-d0ed-4fea-9456-92c4c8f025ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865b9130-d0ed-4fea-9456-92c4c8f025ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a850e7-c845-4d9e-a939-843e977549f4', 'volume_name': 'volume-e2a850e7-c845-4d9e-a939-843e977549f4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc8d070-25aa-48ee-b3b0-800806a7b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc8d070-25aa-48ee-b3b0-800806a7b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2598fc42-c4f9-4c27-9a31-a4cfdb72f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:19 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Volume e2a850e7-c845-4d9e-a939-843e977549f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a850e7-c845-4d9e-a939-843e977549f4', 'volume_size': 1} Feb 27 02:14:19 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-7144a9c3-12f2-46fc-97e1-162a2a12f138-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-7144a9c3-12f2-46fc-97e1-162a2a12f138-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "cinder-quobyte-7144a9c3-12f2-46fc-97e1-162a2a12f138" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-7144a9c3-12f2-46fc-97e1-162a2a12f138" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc680b37-6df9-49cd-9c85-e858bf3d2392]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 Feb 27 02:14:20 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:20 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0" returned: 0 in 0.452s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info Feb 27 02:14:20 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:20 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138" returned: 0 in 0.505s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138 Feb 27 02:14:20 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:20 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info" returned: 0 in 0.414s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:20 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info is being set with open permissions: ugo+rw Feb 27 02:14:20 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:20 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info Feb 27 02:14:20 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:21 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7144a9c3-12f2-46fc-97e1-162a2a12f138" returned: 0 in 0.419s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-quobyte-7144a9c3-12f2-46fc-97e1-162a2a12f138" released by "delete_volume" :: held 0.952s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Created reservations ['ab0895cc-5f9e-4d3c-ba88-c9b6c351942c', '729dd80f-7b10-445a-86c6-e0047abd5c06', '1da65e33-f8ed-456a-a7e9-b0641160df7a', 'db3b39a4-e5fc-46f9-8cc0-d5dd061618c7'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:21 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.info" returned: 0 in 0.439s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.177s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc-8322f6cf-f933-418e-b7b3-6e31d2850c3a" by "_create_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:21 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:21 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc-8322f6cf-f933-418e-b7b3-6e31d2850c3a" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Creating volume 8322f6cf-f933-418e-b7b3-6e31d2850c3a from snapshot 82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9ce6e547-57cd-4827-aee1-6bdb896b58da tempest-CreateVolumesFromSnapshotTest-1000084497 None] Create snapshot completed successfully Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] snapshot: 82ed7b59-230d-4736-932e-1a686b466dcc, volume: 8322f6cf-f933-418e-b7b3-6e31d2850c3a, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8d507a-d010-48af-85da-7edc2cf60a68]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:21 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:21 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:21 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.423s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:21 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Deleted volume successfully. Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-6fc09473-9609-425d-83fa-4a65e4dc91a6 tempest-CreateVolumesFromSourceVolumeTest-1691198606 None] Lock "cinder-7144a9c3-12f2-46fc-97e1-162a2a12f138-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:21 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19caee67-2f9b-4759-b721-963f2d68e1b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[08304274-b2a5-4917-a6ce-a96959067201]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:21 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:21 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:21 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:22 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.544s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:22 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (854a6d6e-a199-4f6a-9abc-29cbe48d2b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:22 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29cacc-45ab-4dde-82e9-70a40b4a828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b29cacc-45ab-4dde-82e9-70a40b4a828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91509015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a31ac52-44d4-4313-ada9-0a6a00bfa176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:22Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090ba4f-dfcb-4e03-ab63-1dc686f53ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090ba4f-dfcb-4e03-ab63-1dc686f53ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15a474f-97d5-436a-b7be-ddc216a28aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15a474f-97d5-436a-b7be-ddc216a28aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a31ac52-44d4-4313-ada9-0a6a00bfa176', 'volume_name': 'volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459051da-5fdb-4365-8a6a-d50e0cd9e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459051da-5fdb-4365-8a6a-d50e0cd9e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412924cf-c261-48fd-9802-b8066d579770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume 1a31ac52-44d4-4313-ada9-0a6a00bfa176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176', 'volume_size': 1} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (240b81fa-b409-4d71-9dcc-b98a49b96ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3920403d-9bfa-4d77-b025-442396de2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3920403d-9bfa-4d77-b025-442396de2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775296915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879196b3-94b9-45f8-96a9-830f3da1c32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:22Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20ac52d-5110-4a03-aaec-87319b146475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20ac52d-5110-4a03-aaec-87319b146475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4c4d52-b1b0-4ccf-9c54-72369d45e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4c4d52-b1b0-4ccf-9c54-72369d45e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879196b3-94b9-45f8-96a9-830f3da1c32b', 'volume_name': 'volume-879196b3-94b9-45f8-96a9-830f3da1c32b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4afbb42-e029-4567-ba64-8b8323b6ab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4afbb42-e029-4567-ba64-8b8323b6ab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b2d391-26f1-445b-804b-d4bfa591cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume 879196b3-94b9-45f8-96a9-830f3da1c32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879196b3-94b9-45f8-96a9-830f3da1c32b', 'volume_size': 1} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (104de86f-aebc-49b4-aead-498f0c8510b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef07d83-3540-4e7f-8405-ad84a3cb7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef07d83-3540-4e7f-8405-ad84a3cb7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111598781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dee366e-68d2-4cff-afc6-c44817acdce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403b071a-1fbc-4d7b-8c28-4ad13c596921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403b071a-1fbc-4d7b-8c28-4ad13c596921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76185b6e-820b-491d-a6e8-c33d708e9120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76185b6e-820b-491d-a6e8-c33d708e9120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dee366e-68d2-4cff-afc6-c44817acdce8', 'volume_name': 'volume-3dee366e-68d2-4cff-afc6-c44817acdce8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44759ae5-40c2-460c-a008-995deee6eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44759ae5-40c2-460c-a008-995deee6eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7de89c-6a46-4862-a415-5c796a55feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:22 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume 3dee366e-68d2-4cff-afc6-c44817acdce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dee366e-68d2-4cff-afc6-c44817acdce8', 'volume_size': 1} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:22 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Flow 'volume_create_manager' (ceb4869f-ee4d-497d-91c4-92f37a8812da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ff3b65-a448-4fa9-bdf5-24f97e1b3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ff3b65-a448-4fa9-bdf5-24f97e1b3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ad10da-7f85-44f7-a84a-c7952b8eea9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a65cfff5634971998285385ca727e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c0c5a8f784ac4f9e80bae56ce314a7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575c8708-06c9-4223-b537-07f0fee0ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575c8708-06c9-4223-b537-07f0fee0ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c45c9f-2d8a-46ce-a725-5c795c2bce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c45c9f-2d8a-46ce-a725-5c795c2bce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ad10da-7f85-44f7-a84a-c7952b8eea9c', 'volume_name': 'volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1130dae9-ab4b-4881-9d83-6a37948ada73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1130dae9-ab4b-4881-9d83-6a37948ada73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6063d2-8d74-4069-a203-63ee8a07b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Volume e1ad10da-7f85-44f7-a84a-c7952b8eea9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c', 'volume_size': 1} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (47780305-1eb1-4a42-8bc4-b0c6433aff83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c68a060-8e7a-4a20-aa20-5f0afd92881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c68a060-8e7a-4a20-aa20-5f0afd92881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401563907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deda1343-8014-46c8-bc5f-4750e3ca061d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e851553f-2651-40ca-8151-add9c3904a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e851553f-2651-40ca-8151-add9c3904a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d73aa3-f69a-48df-aab9-2fd4bee16357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d73aa3-f69a-48df-aab9-2fd4bee16357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deda1343-8014-46c8-bc5f-4750e3ca061d', 'volume_name': 'volume-deda1343-8014-46c8-bc5f-4750e3ca061d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e25359e-7286-4a08-928a-f45c54d7ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e25359e-7286-4a08-928a-f45c54d7ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa56b27-7367-4213-acb9-43eb61af9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:23 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume deda1343-8014-46c8-bc5f-4750e3ca061d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deda1343-8014-46c8-bc5f-4750e3ca061d', 'volume_size': 1} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:23 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (69891fe6-5b93-476e-ae02-b52b123e03fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6facf82-cd82-4ed6-9993-c3ea5ccc4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6facf82-cd82-4ed6-9993-c3ea5ccc4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528992217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5572d52-b026-49fa-9444-7109bfe6367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:24Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378a9c33-7c4c-445e-93e8-f60d46f6e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378a9c33-7c4c-445e-93e8-f60d46f6e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48468400-ada4-4c8a-8ccc-3de85e652a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48468400-ada4-4c8a-8ccc-3de85e652a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5572d52-b026-49fa-9444-7109bfe6367b', 'volume_name': 'volume-e5572d52-b026-49fa-9444-7109bfe6367b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1628da50-2578-442d-8e41-6bbace9f0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1628da50-2578-442d-8e41-6bbace9f0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690dd8b4-deff-4474-80d4-2d7f4a7b4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:24 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume e5572d52-b026-49fa-9444-7109bfe6367b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5572d52-b026-49fa-9444-7109bfe6367b', 'volume_size': 1} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:24 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a" returned: 0 in 2.438s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14e4fc-99b7-450a-8d53-76b7ebb57d82]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:24 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:24 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:24 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:25 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.586s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:14:25 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Converted 1024.00 MB image at 419.95 MB/s Feb 27 02:14:25 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a is being set with open permissions: ugo+rw Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:25 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a Feb 27 02:14:25 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:25 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a" returned: 0 in 0.377s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" released by "_copy_volume_from_snapshot" :: held 4.522s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc-8322f6cf-f933-418e-b7b3-6e31d2850c3a" released by "_create_volume_from_snapshot" :: held 4.546s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.587s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.879s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-977577729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a850e7-c845-4d9e-a939-843e977549f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:20Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Creating volume e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:25 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:25 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 1073741824 Feb 27 02:14:25 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333023b2-f52a-4292-a215-e924d01f58bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a', 'volume_size': 1, 'snapshot_id': '82ed7b59-230d-4736-932e-1a686b466dcc'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1acdb-8d02-4451-9283-aa063229ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:25 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Volume volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a (8322f6cf-f933-418e-b7b3-6e31d2850c3a): created successfully Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1acdb-8d02-4451-9283-aa063229ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:25 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Flow 'volume_create_manager' (91f43f76-aa15-41e6-9514-6a1cfd3ac6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:25 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-be7b1f4a-f735-4e54-bef3-1f3aa04a5f4b tempest-SnapshotDependencyTests-1892661838 None] Created volume successfully. Feb 27 02:14:26 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 1073741824" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:26 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:26 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-82ed7b59-230d-4736-932e-1a686b466dcc-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-82ed7b59-230d-4736-932e-1a686b466dcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Deleting offline snapshot 82ed7b59-230d-4736-932e-1a686b466dcc of volume 19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] snapshot_file for this snap is: volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eeec67-b955-4f0a-afaf-4255701b2807]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:26 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:26 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:26 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.404s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.298s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-91509015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a31ac52-44d4-4313-ada9-0a6a00bfa176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:22Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume 1a31ac52-44d4-4313-ada9-0a6a00bfa176 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:26 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2598fc42-c4f9-4c27-9a31-a4cfdb72f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a850e7-c845-4d9e-a939-843e977549f4', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:26 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 1073741824 Feb 27 02:14:26 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b803f218-b27d-4d06-8cf2-385f944c1046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:26 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Volume volume-e2a850e7-c845-4d9e-a939-843e977549f4 (e2a850e7-c845-4d9e-a939-843e977549f4): created successfully Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b803f218-b27d-4d06-8cf2-385f944c1046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (651e4354-5d71-4e3a-84d8-095509ac4961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:26 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-37abb3f8-b8ac-4af1-89ac-158edbf9b226 tempest-VolumeDependencyTests-946759678 None] Created volume successfully. Feb 27 02:14:26 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19caee67-2f9b-4759-b721-963f2d68e1b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee62b95-581e-4f36-bb18-ff14996b4a5e]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:26 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:27 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:27 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:27 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 1073741824" returned: 0 in 0.470s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:27 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 Feb 27 02:14:27 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (f46a339f-9bee-4063-a844-a4cedaef5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735df0ee-0d0e-407b-a8f5-26c9021a7ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735df0ee-0d0e-407b-a8f5-26c9021a7ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1909143088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c55002-0925-43e7-afcd-e5a1a2376011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8862cfdebf3f4239b29727b015384042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e2a850e7-c845-4d9e-a939-843e977549f4,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:27Z,use_quota=True,user_id='ac96e518fd6d499183250735f0ba1853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81300764-31da-4341-b327-9468526f6944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81300764-31da-4341-b327-9468526f6944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ad1dd5-f5fc-4f68-b741-457ddeab5602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.597s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ad1dd5-f5fc-4f68-b741-457ddeab5602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80c55002-0925-43e7-afcd-e5a1a2376011', 'volume_name': 'volume-80c55002-0925-43e7-afcd-e5a1a2376011', 'volume_size': 1, 'source_volid': 'e2a850e7-c845-4d9e-a939-843e977549f4', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803a53e2-0390-47cc-841a-34dbc159ce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803a53e2-0390-47cc-841a-34dbc159ce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfa401a-95ba-4400-b2e7-a390cc9cd933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Volume 80c55002-0925-43e7-afcd-e5a1a2376011: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80c55002-0925-43e7-afcd-e5a1a2376011', 'volume_size': 1, 'source_volid': 'e2a850e7-c845-4d9e-a939-843e977549f4', 'source_volstatus': 'available'} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:27 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:27 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:27 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176" returned: 0 in 0.483s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.075s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775296915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879196b3-94b9-45f8-96a9-830f3da1c32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:22Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume 879196b3-94b9-45f8-96a9-830f3da1c32b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:27 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412924cf-c261-48fd-9802-b8066d579770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a525b1b-7d75-4ae1-a1d6-0c1f5791d3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:27 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b 1073741824 Feb 27 02:14:27 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:27 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 (1a31ac52-44d4-4313-ada9-0a6a00bfa176): created successfully Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a525b1b-7d75-4ae1-a1d6-0c1f5791d3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:27 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (854a6d6e-a199-4f6a-9abc-29cbe48d2b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:27 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-04a1898c-c231-4027-bbbc-3f6ba67e0121 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:28 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.460s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:28 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc Feb 27 02:14:28 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:28 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b 1073741824" returned: 0 in 0.476s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:28 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b Feb 27 02:14:28 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:28 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7.82ed7b59-230d-4736-932e-1a686b466dcc" returned: 0 in 0.429s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-82ed7b59-230d-4736-932e-1a686b466dcc" released by "_delete_snapshot" :: held 2.065s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" released by "delete_snapshot" :: held 2.083s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Created reservations ['6043881e-2f77-4f09-a94b-e3ebcc49bd19', '67340753-1a66-4d5e-a159-6846f052462f', '5b4a77d2-303f-4122-8836-c490022ab450', 'e47e5247-17c4-45e1-84d1-ec0cf1d4d2b4'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:28 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b" returned: 0 in 0.456s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.799s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111598781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dee366e-68d2-4cff-afc6-c44817acdce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume 3dee366e-68d2-4cff-afc6-c44817acdce8 {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:28 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:28 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 1073741824 Feb 27 02:14:28 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Delete snapshot completed successfully. Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b2d391-26f1-445b-804b-d4bfa591cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879196b3-94b9-45f8-96a9-830f3da1c32b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b671b7-afbe-4acb-a1e1-00824e592265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e5d45200-52eb-479e-b92e-7b53418285cc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-82ed7b59-230d-4736-932e-1a686b466dcc-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:28 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-879196b3-94b9-45f8-96a9-830f3da1c32b (879196b3-94b9-45f8-96a9-830f3da1c32b): created successfully Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b671b7-afbe-4acb-a1e1-00824e592265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:28 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (240b81fa-b409-4d71-9dcc-b98a49b96ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:28 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4dcba857-3620-447a-80ab-159405778c5a tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:29 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 1073741824" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:29 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 Feb 27 02:14:29 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:29 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8" returned: 0 in 0.453s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.414s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ad10da-7f85-44f7-a84a-c7952b8eea9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a65cfff5634971998285385ca727e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c0c5a8f784ac4f9e80bae56ce314a7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Creating volume e1ad10da-7f85-44f7-a84a-c7952b8eea9c {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:29 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7de89c-6a46-4862-a415-5c796a55feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dee366e-68d2-4cff-afc6-c44817acdce8', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:29 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c 1073741824 Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b2a8c-ddfb-482a-af71-5942bd15e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:29 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:29 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-3dee366e-68d2-4cff-afc6-c44817acdce8 (3dee366e-68d2-4cff-afc6-c44817acdce8): created successfully Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305b2a8c-ddfb-482a-af71-5942bd15e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (104de86f-aebc-49b4-aead-498f0c8510b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-19caee67-2f9b-4759-b721-963f2d68e1b7-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:29 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-8dc4284b-c2db-4ed8-a137-0ab12a467484 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-19caee67-2f9b-4759-b721-963f2d68e1b7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c6efde-61aa-4aef-a763-1fbd1a6498f6]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:29 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:29 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:29 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:30 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c 1073741824" returned: 0 in 0.539s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:30 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c Feb 27 02:14:30 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:30 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.498s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:30 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7 Feb 27 02:14:30 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:30 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" returned: 0 in 0.464s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.343s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401563907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deda1343-8014-46c8-bc5f-4750e3ca061d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:23Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume deda1343-8014-46c8-bc5f-4750e3ca061d {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:30 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6063d2-8d74-4069-a203-63ee8a07b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:30 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba1f513-be7f-4e28-8925-72472434d676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:30 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d 1073741824 Feb 27 02:14:30 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-19caee67-2f9b-4759-b721-963f2d68e1b7" returned: 0 in 0.485s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:30 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Volume volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c (e1ad10da-7f85-44f7-a84a-c7952b8eea9c): created successfully Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba1f513-be7f-4e28-8925-72472434d676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Flow 'volume_create_manager' (ceb4869f-ee4d-497d-91c4-92f37a8812da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:30 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a2195438-d2b8-4d1e-b435-f638ae1513ff tempest-CinderUnicodeTest-221413355 None] Created volume successfully. Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-19caee67-2f9b-4759-b721-963f2d68e1b7" released by "delete_volume" :: held 1.030s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Created reservations ['3d98fbd6-f20d-421c-835a-fcc249b71485', '33a555bd-7b3f-4de8-900c-3b3a6876024a', '7d7643ae-69d1-48fe-83b8-181471743d5d', '5bcc9607-1a74-4c70-aca4-7dc104846962'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:30 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:30 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:30 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:31 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d 1073741824" returned: 0 in 0.496s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:31 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d Feb 27 02:14:31 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:31 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.440s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:31 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Deleted volume successfully. Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-778a6ee8-f6bf-4f50-bd53-0dfa661f0bdc tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-19caee67-2f9b-4759-b721-963f2d68e1b7-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:31 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d" returned: 0 in 0.438s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.363s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528992217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5572d52-b026-49fa-9444-7109bfe6367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8dbc06808c4261a60566cbb628979f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:24Z,use_quota=True,user_id='c363deb3e61b4cd192124eb7b8fdc9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Creating volume e5572d52-b026-49fa-9444-7109bfe6367b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:31 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa56b27-7367-4213-acb9-43eb61af9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deda1343-8014-46c8-bc5f-4750e3ca061d', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b 1073741824 Feb 27 02:14:31 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f2d89a-e60a-40c5-b7c3-c307b8cb0564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83211) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Flow 'volume_create_manager' (146814ff-baf3-42cb-a53a-a80cfbfecba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d21974-6ec0-4736-a345-6e72c0cc72b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-deda1343-8014-46c8-bc5f-4750e3ca061d (deda1343-8014-46c8-bc5f-4750e3ca061d): created successfully Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f2d89a-e60a-40c5-b7c3-c307b8cb0564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (47780305-1eb1-4a42-8bc4-b0c6433aff83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d21974-6ec0-4736-a345-6e72c0cc72b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-643644217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7932fc06-61e3-4e30-86f6-ac420c43132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a65cfff5634971998285385ca727e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='c0c5a8f784ac4f9e80bae56ce314a7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638af2e4-99d8-44c0-97c9-40fd3e569c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638af2e4-99d8-44c0-97c9-40fd3e569c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346ffd7-8406-4210-8ff3-eb221efb787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346ffd7-8406-4210-8ff3-eb221efb787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7932fc06-61e3-4e30-86f6-ac420c43132b', 'volume_name': 'volume-7932fc06-61e3-4e30-86f6-ac420c43132b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a328c1-cf5c-4c14-a531-ced228e179db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a328c1-cf5c-4c14-a531-ced228e179db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8106a5a-e2dd-478a-a585-d99c98dd0388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:31 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Volume 7932fc06-61e3-4e30-86f6-ac420c43132b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7932fc06-61e3-4e30-86f6-ac420c43132b', 'volume_size': 1} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:31 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-97f911d7-4969-4686-8042-7fbb8056864c tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-8322f6cf-f933-418e-b7b3-6e31d2850c3a-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-8322f6cf-f933-418e-b7b3-6e31d2850c3a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222ba5a-e817-4384-9f92-a34e66379cbe]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:31 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:31 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a Feb 27 02:14:31 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b 1073741824" returned: 0 in 0.474s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b Feb 27 02:14:32 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a" returned: 0 in 0.475s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a Feb 27 02:14:32 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b" returned: 0 in 0.436s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.888s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:32 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Cloning volume e2a850e7-c845-4d9e-a939-843e977549f4 to volume 80c55002-0925-43e7-afcd-e5a1a2376011 Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690dd8b4-deff-4474-80d4-2d7f4a7b4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5572d52-b026-49fa-9444-7109bfe6367b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb36115-a327-4829-a69c-d044d8d14db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Creating offline snapshot 08c61f45-ae70-4746-a374-89f3dd2ab4c1 of volume e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:32 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Volume volume-e5572d52-b026-49fa-9444-7109bfe6367b (e5572d52-b026-49fa-9444-7109bfe6367b): created successfully Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb36115-a327-4829-a69c-d044d8d14db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Flow 'volume_create_manager' (69891fe6-5b93-476e-ae02-b52b123e03fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942dbd4-380a-4c51-9c4f-933f105fb9cd]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5b95293e-cb0e-4295-8bcc-f3efe0b77c23 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created volume successfully. Feb 27 02:14:32 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:32 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-8322f6cf-f933-418e-b7b3-6e31d2850c3a" returned: 0 in 0.455s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-quobyte-8322f6cf-f933-418e-b7b3-6e31d2850c3a" released by "delete_volume" :: held 0.971s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Created reservations ['3ee66d19-df84-434a-b296-d3c704a6d984', '4b8ee2b8-2479-4331-824b-9eb09f112da9', '64fba97c-1028-4bc8-a933-ad3bc9798ab0', 'c65b72ad-5a34-442e-b18a-d6a5883b9ef4'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-e5572d52-b026-49fa-9444-7109bfe6367b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-e5572d52-b026-49fa-9444-7109bfe6367b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-e5572d52-b026-49fa-9444-7109bfe6367b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-e5572d52-b026-49fa-9444-7109bfe6367b" acquired by "delete_volume" :: waited 0.038s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:32 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:32 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2116c48-d9e2-45dd-b641-1fcaaafc98b8]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:32 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b Feb 27 02:14:33 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.524s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 1G Feb 27 02:14:33 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.381s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:33 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Deleted volume successfully. Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-5c77b1e6-0322-4757-9f13-74fe57c56094 tempest-SnapshotDependencyTests-1892661838 None] Lock "cinder-8322f6cf-f933-418e-b7b3-6e31d2850c3a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:33 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b" returned: 0 in 0.487s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b Feb 27 02:14:33 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 1G" returned: 0 in 0.490s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a850e7-c845-4d9e-a939-843e977549f4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a850e7-c845-4d9e-a939-843e977549f4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:33 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:33 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e5572d52-b026-49fa-9444-7109bfe6367b" returned: 0 in 0.414s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-e5572d52-b026-49fa-9444-7109bfe6367b" released by "delete_volume" :: held 0.926s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['ea7b0c12-3dda-4efa-ad7f-421026672477', '63d4d360-a36f-4a6b-b7c2-c1cd799dc9b0', '4058be72-9f1c-44e5-9828-418816f770c5', 'e04365fe-c72b-498f-a0fb-ad4f6b693ac5'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:33 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:33 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:33 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-deda1343-8014-46c8-bc5f-4750e3ca061d-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-deda1343-8014-46c8-bc5f-4750e3ca061d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-deda1343-8014-46c8-bc5f-4750e3ca061d" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-deda1343-8014-46c8-bc5f-4750e3ca061d" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a8986-f9fb-4e89-a12a-65e6236fba9b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2a850e7-c845-4d9e-a939-843e977549f4 -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.530s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 is being set with open permissions: ugo+rw Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:34 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d Feb 27 02:14:34 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.458s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:34 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9493afa-ad03-46d6-8d31-3c6be0cf26c7 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-e5572d52-b026-49fa-9444-7109bfe6367b-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:34 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.487s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info Feb 27 02:14:34 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:34 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d" returned: 0 in 0.595s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:34 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:34 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d Feb 27 02:14:34 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info" returned: 0 in 0.461s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info is being set with open permissions: ugo+rw Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:35 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info Feb 27 02:14:35 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-deda1343-8014-46c8-bc5f-4750e3ca061d" returned: 0 in 0.483s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-deda1343-8014-46c8-bc5f-4750e3ca061d" released by "delete_volume" :: held 1.105s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['4d239164-d7d3-4c3a-9728-ebdd4c734312', 'e7fb8a94-9784-4e60-bc72-07ec78c1cba7', 'a9f92e5d-ed16-4c4e-9a10-f3506dc95664', 'b83e6c66-76ab-4415-a20f-f4381f739686'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:35 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:35 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.info" returned: 0 in 0.472s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" by "_copy_volume_from_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] snapshot: 08c61f45-ae70-4746-a374-89f3dd2ab4c1, volume: 80c55002-0925-43e7-afcd-e5a1a2376011, {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc757c0-3a13-49cb-96ec-2afa7b2efd89]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:35 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:35 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:35 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.510s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:35 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:35 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-92cf3b04-fa14-45a4-ae81-31a1759f1350 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-deda1343-8014-46c8-bc5f-4750e3ca061d-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:36 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.581s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a850e7-c845-4d9e-a939-843e977549f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Creating direct copy from snapshot {{(pid=83211) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4eeb95-f8ab-4ac9-9386-e2bb24a0f1b4]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-3dee366e-68d2-4cff-afc6-c44817acdce8-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-3dee366e-68d2-4cff-afc6-c44817acdce8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-3dee366e-68d2-4cff-afc6-c44817acdce8" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-3dee366e-68d2-4cff-afc6-c44817acdce8" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:36 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[27333f5b-5e07-4c01-9394-1798957b5a78]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:36 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 Feb 27 02:14:36 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:36 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8" returned: 0 in 0.477s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8 Feb 27 02:14:36 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:36 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.641s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG cinder.utils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Path /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 not found in is_blk_device check {{(pid=83211) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:14:36 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:36 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 Feb 27 02:14:36 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:37 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-3dee366e-68d2-4cff-afc6-c44817acdce8" returned: 0 in 0.427s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-3dee366e-68d2-4cff-afc6-c44817acdce8" released by "delete_volume" :: held 0.936s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['0207099e-6497-4f57-a827-b715d7d74b28', 'ab7013f7-3edc-4c70-bc82-c9d98eadb832', '9c9bee34-2d76-4291-bd32-0e9bff99e5b2', '95af0774-5f2b-4458-8f84-01eb6b664205'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:37 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:37 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-879196b3-94b9-45f8-96a9-830f3da1c32b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-879196b3-94b9-45f8-96a9-830f3da1c32b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-879196b3-94b9-45f8-96a9-830f3da1c32b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-879196b3-94b9-45f8-96a9-830f3da1c32b" acquired by "delete_volume" :: waited 0.035s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f660290-72e7-4206-b324-32ed8ee18b36]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:37 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:38 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b Feb 27 02:14:38 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:38 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:38 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 1.057s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:38 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:38 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:38 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-a9e944c2-17f8-49c5-b2a5-75242aabe27b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-3dee366e-68d2-4cff-afc6-c44817acdce8-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:39 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011" returned: 0 in 2.236s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de182e4-125b-4fa3-a897-0a4813937dde]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:39 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b" returned: 0 in 1.552s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b Feb 27 02:14:39 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-879196b3-94b9-45f8-96a9-830f3da1c32b" returned: 0 in 0.472s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-879196b3-94b9-45f8-96a9-830f3da1c32b" released by "delete_volume" :: held 2.061s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['5b6f2469-3b97-4746-a6f0-08ecd61e211b', '47d05b7f-0790-40f3-9c8d-71dfb936b5a5', '60245274-e3c3-4a05-a64f-f100e244b767', '63c49f5d-50dd-415c-82b7-6dc9b95b89f9'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:39 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.693s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.image.image_utils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 {{(pid=83211) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:14:39 devstack cinder-volume[83211]: INFO cinder.image.image_utils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Converted 1024.00 MB image at 457.70 MB/s Feb 27 02:14:39 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 is being set with open permissions: ugo+rw Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:39 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 Feb 27 02:14:39 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-1a31ac52-44d4-4313-ada9-0a6a00bfa176-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-1a31ac52-44d4-4313-ada9-0a6a00bfa176-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-1a31ac52-44d4-4313-ada9-0a6a00bfa176" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-1a31ac52-44d4-4313-ada9-0a6a00bfa176" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa87dc4-d408-4240-8e65-04aab31e2de9]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:39 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:40 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 Feb 27 02:14:40 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.512s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:40 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-be72aa76-a7ca-4ddc-96ce-7abd08b20a7b tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-879196b3-94b9-45f8-96a9-830f3da1c32b-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:40 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011" returned: 0 in 0.562s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" released by "_copy_volume_from_snapshot" :: held 4.762s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-08c61f45-ae70-4746-a374-89f3dd2ab4c1" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-08c61f45-ae70-4746-a374-89f3dd2ab4c1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Deleting offline snapshot 08c61f45-ae70-4746-a374-89f3dd2ab4c1 of volume e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] snapshot_file for this snap is: volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673201d-b9f7-41e7-a1ec-2d7df9cdc9ec]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:40 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:40 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176" returned: 0 in 0.683s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:40 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176 Feb 27 02:14:40 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:40 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.524s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2a850e7-c845-4d9e-a939-843e977549f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a29c561-3033-432a-8a3a-85b63f4cda1b]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:40 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:41 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-1a31ac52-44d4-4313-ada9-0a6a00bfa176" returned: 0 in 0.489s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-1a31ac52-44d4-4313-ada9-0a6a00bfa176" released by "delete_volume" :: held 1.197s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['8020efe9-6768-45fd-81fa-95912bba1c88', 'b5ab12d2-7349-428c-b749-4d01d74d8a80', '1977c632-1b38-46a5-b885-d9c4626307ff', '9f9d1710-20f3-464d-aa0b-223f55456611'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:41 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.584s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:41 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:41 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:41 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.447s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:41 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:41 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-51d08217-69c7-4446-819a-8e40cba391c4 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-1a31ac52-44d4-4313-ada9-0a6a00bfa176-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:42 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1 Feb 27 02:14:42 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-976bc81b-2765-48e7-8799-dd00045d45e0-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-976bc81b-2765-48e7-8799-dd00045d45e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-976bc81b-2765-48e7-8799-dd00045d45e0" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-976bc81b-2765-48e7-8799-dd00045d45e0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleting offline snapshot 976bc81b-2765-48e7-8799-dd00045d45e0 of volume ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] snapshot_file for this snap is: volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b52d26-10e5-44ab-b299-b4130bc5ba04]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 Feb 27 02:14:42 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4.08c61f45-ae70-4746-a374-89f3dd2ab4c1" returned: 0 in 0.441s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-08c61f45-ae70-4746-a374-89f3dd2ab4c1" released by "_delete_snapshot" :: held 2.106s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.989s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.814s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:14:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-643644217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7932fc06-61e3-4e30-86f6-ac420c43132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a65cfff5634971998285385ca727e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:14:32Z,use_quota=True,user_id='c0c5a8f784ac4f9e80bae56ce314a7bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90266f13-d0a0-45f0-897a-3a3300d6e9bf),volume_type_id=90266f13-d0a0-45f0-897a-3a3300d6e9bf)}" {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Creating volume 7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Selected osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 as target Quobyte volume. {{(pid=83211) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:14:42 devstack cinder-volume[83211]: INFO cinder.volume.drivers.remotefs [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] casted to osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9 Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b 1073741824 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cfa401a-95ba-4400-b2e7-a390cc9cd933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c55002-0925-43e7-afcd-e5a1a2376011', 'volume_size': 1, 'source_volid': 'e2a850e7-c845-4d9e-a939-843e977549f4', 'source_volstatus': 'available'}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:42 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b 1073741824 Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04295d3c-b4ff-4720-82bc-c504b71dad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:42 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:42 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Volume volume-80c55002-0925-43e7-afcd-e5a1a2376011 (80c55002-0925-43e7-afcd-e5a1a2376011): created successfully Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04295d3c-b4ff-4720-82bc-c504b71dad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Flow 'volume_create_manager' (f46a339f-9bee-4063-a844-a4cedaef5143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:42 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-12e3d9f9-cbd8-46d4-96f8-03abbde1da6e tempest-VolumeDependencyTests-946759678 None] Created volume successfully. Feb 27 02:14:42 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae3bc209-e06d-4990-8673-f5710be50396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd6567-cd43-4842-b789-7d3d886b0634]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:42 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:42 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 Feb 27 02:14:42 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b 1073741824" returned: 0 in 0.507s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b Feb 27 02:14:43 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396" returned: 0 in 0.519s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 Feb 27 02:14:43 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-e2a850e7-c845-4d9e-a939-843e977549f4-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "cinder-e2a850e7-c845-4d9e-a939-843e977549f4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-e2a850e7-c845-4d9e-a939-843e977549f4" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-e2a850e7-c845-4d9e-a939-843e977549f4" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[288a418d-54f6-4fbc-ac46-e9d3eb53dd28]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b" returned: 0 in 0.476s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'} {{(pid=83211) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8106a5a-e2dd-478a-a585-d99c98dd0388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7932fc06-61e3-4e30-86f6-ac420c43132b', 'volume_size': 1}' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f79ab8-9997-4037-b74c-04a83e31b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:14:43 devstack cinder-volume[83211]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Volume volume-7932fc06-61e3-4e30-86f6-ac420c43132b (7932fc06-61e3-4e30-86f6-ac420c43132b): created successfully Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f79ab8-9997-4037-b74c-04a83e31b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83211) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Flow 'volume_create_manager' (146814ff-baf3-42cb-a53a-a80cfbfecba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83211) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:14:43 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-4c5e5539-2bf0-4cc0-9072-2254d719f511 tempest-CinderUnicodeTest-221413355 None] Created volume successfully. Feb 27 02:14:43 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:43 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0" returned: 0 in 0.481s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:43 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0 Feb 27 02:14:43 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:43 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.516s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:43 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4 Feb 27 02:14:44 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396.976bc81b-2765-48e7-8799-dd00045d45e0" returned: 0 in 0.418s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-976bc81b-2765-48e7-8799-dd00045d45e0" released by "_delete_snapshot" :: held 1.994s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" released by "delete_snapshot" :: held 2.008s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['92edf744-4699-4674-afbf-de004fae1948', '7618981b-62c3-4680-ae75-8547f535cb14', '21d6705e-f89f-4b1e-9a37-0ddeae0685b1', '0b82653a-fd71-4ae2-a600-00c603e2fbb7'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:44 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Delete snapshot completed successfully. Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-ec54a55e-db0e-49b0-9895-9c9a85aade7e tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-976bc81b-2765-48e7-8799-dd00045d45e0-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:44 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e2a850e7-c845-4d9e-a939-843e977549f4" returned: 0 in 0.466s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-e2a850e7-c845-4d9e-a939-843e977549f4" released by "delete_volume" :: held 1.010s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Created reservations ['00436edb-1996-4832-9586-cf765be68166', '67de5d48-424a-43f3-a1a3-8729f137d009', 'e6a11758-275a-49a2-9947-77092de278ac', '20db1daa-4f59-40b1-a05d-8d32c5b6a800'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:44 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-80c55002-0925-43e7-afcd-e5a1a2376011-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "cinder-80c55002-0925-43e7-afcd-e5a1a2376011-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[43572d70-7674-4319-b251-fd49dd932975]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:44 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 Feb 27 02:14:44 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Creating offline snapshot 60279766-148f-4a68-a498-878d55da9b21 of volume 7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[703dc408-74b4-4690-894d-f33fc2535d65]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:44 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:44 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b Feb 27 02:14:44 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.475s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:45 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Deleted volume successfully. Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-e68b4a62-e88e-4e7b-b0d0-824da763895c tempest-VolumeDependencyTests-946759678 None] Lock "cinder-e2a850e7-c845-4d9e-a939-843e977549f4-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:45 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011" returned: 0 in 0.500s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011 Feb 27 02:14:45 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-ae3bc209-e06d-4990-8673-f5710be50396-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-ae3bc209-e06d-4990-8673-f5710be50396-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:45 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b" returned: 0 in 0.529s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 1G {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:45 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 1G Feb 27 02:14:45 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546b2de-5f4d-4996-a3f4-46b75716602c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 Feb 27 02:14:45 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-80c55002-0925-43e7-afcd-e5a1a2376011" returned: 0 in 0.473s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-80c55002-0925-43e7-afcd-e5a1a2376011" released by "delete_volume" :: held 1.006s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Created reservations ['4e3193e1-95fb-4dd2-9a68-68f4b637d149', '062b878e-a411-4d3f-8263-0eada5336d37', '0dded8ea-2392-4a53-9270-fb6be9736bf0', 'fe3f3666-2dc4-4b3a-8534-ae1dbf8b606d'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 1G" returned: 0 in 0.514s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7932fc06-61e3-4e30-86f6-ac420c43132b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:45 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7932fc06-61e3-4e30-86f6-ac420c43132b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 Feb 27 02:14:45 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:45 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396" returned: 0 in 0.563s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:45 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:45 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396 Feb 27 02:14:45 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.455s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7932fc06-61e3-4e30-86f6-ac420c43132b -F qcow2 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21" returned: 0 in 0.441s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 is being set with open permissions: ugo+rw Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Deleted volume successfully. Feb 27 02:14:46 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 Feb 27 02:14:46 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-824627ec-170f-48bd-9cbb-3e14f576e5ee tempest-VolumeDependencyTests-946759678 None] Lock "cinder-80c55002-0925-43e7-afcd-e5a1a2376011-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:46 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-ae3bc209-e06d-4990-8673-f5710be50396" returned: 0 in 0.454s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-quobyte-ae3bc209-e06d-4990-8673-f5710be50396" released by "delete_volume" :: held 1.047s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Created reservations ['c245b082-c091-41df-905b-378906e5563c', '047380f7-d1ab-47c4-b401-457b6e6a0bda', '2187c3a1-e4f6-4ddb-bb2a-70561765860f', 'beed09b9-4922-483e-9393-2347ec41dabe'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:46 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21" returned: 0 in 0.444s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info Feb 27 02:14:46 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:46 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.404s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:46 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Deleted volume successfully. Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-9d833e04-de6b-4305-9836-989321ad5f52 tempest-CreateVolumesFromSnapshotTest-1000084497 None] Lock "cinder-ae3bc209-e06d-4990-8673-f5710be50396-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-f068010b-f0b7-42b5-9d1c-70d12c44a960-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-f068010b-f0b7-42b5-9d1c-70d12c44a960-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5c7e1-bd2d-4368-a035-229483e886ec]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:46 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:46 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 Feb 27 02:14:46 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info" returned: 0 in 0.448s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[83211]: WARNING cinder.volume.drivers.remotefs [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info is being set with open permissions: ugo+rw Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info Feb 27 02:14:47 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960" returned: 0 in 0.492s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960 Feb 27 02:14:47 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:47 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.info" returned: 0 in 0.426s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:47 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-88617976-8a10-4227-8ca9-af5f61271816 tempest-CinderUnicodeTest-221413355 None] Create snapshot completed successfully Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-60279766-148f-4a68-a498-878d55da9b21-delete_snapshot" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-60279766-148f-4a68-a498-878d55da9b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" by "delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-quobyte-60279766-148f-4a68-a498-878d55da9b21" by "_delete_snapshot" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-60279766-148f-4a68-a498-878d55da9b21" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Deleting offline snapshot 60279766-148f-4a68-a498-878d55da9b21 of volume 7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] snapshot_file for this snap is: volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ec365-3431-4d1b-b215-5e684d57bdcb]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:47 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-f068010b-f0b7-42b5-9d1c-70d12c44a960" returned: 0 in 0.554s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:47 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-quobyte-f068010b-f0b7-42b5-9d1c-70d12c44a960" released by "delete_volume" :: held 1.074s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Created reservations ['a1316353-9da2-4249-a6b7-90108c15fd24', '1eaaf9e0-f27b-4739-a189-acbff17bab58', 'd3af3776-d6a3-44c5-9752-85f41462c40b', 'd1e03138-121c-44c7-91df-7a7912a926e6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:48 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 Feb 27 02:14:48 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:48 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:48 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:48 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.502s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:48 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:48 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Deleted volume successfully. Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21" returned: 0 in 0.666s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.remotefs [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7932fc06-61e3-4e30-86f6-ac420c43132b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83211) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce429366-4459-4b8f-927e-ef5555700b9c]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:48 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-b2b4911c-7f6c-4fa8-8f77-d4a7db07b636 tempest-VolumeDependencyTests-946759678 None] Lock "cinder-f068010b-f0b7-42b5-9d1c-70d12c44a960-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:48 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b Feb 27 02:14:48 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:49 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b" returned: 0 in 0.495s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:49 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 Feb 27 02:14:49 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:49 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21" returned: 0 in 0.503s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:49 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:49 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21 Feb 27 02:14:49 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:50 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:50 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b.60279766-148f-4a68-a498-878d55da9b21" returned: 0 in 0.455s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-60279766-148f-4a68-a498-878d55da9b21" released by "_delete_snapshot" :: held 2.179s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" released by "delete_snapshot" :: held 2.193s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:50 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Created reservations ['d7aec963-b8e3-434b-adc7-0aa40f93553b', '371537dd-0751-4cd7-b94f-54992ce0c8f4', '6291d9eb-3f1a-4c2d-a69d-a1e0bad5f8fe', '6770891b-b4a6-4662-9d84-e3580ce359f0'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:50 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Delete snapshot completed successfully. Feb 27 02:14:50 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-3d22c999-bfc6-4568-885c-be392671cfe1 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-60279766-148f-4a68-a498-878d55da9b21-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-7932fc06-61e3-4e30-86f6-ac420c43132b-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "cinder-7932fc06-61e3-4e30-86f6-ac420c43132b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" acquired by "delete_volume" :: waited 0.007s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[66066d6a-01da-4506-82e4-1da4a464e86f]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b Feb 27 02:14:51 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:51 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b" returned: 0 in 0.459s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:51 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b Feb 27 02:14:51 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:51 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-7932fc06-61e3-4e30-86f6-ac420c43132b" returned: 0 in 0.377s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-7932fc06-61e3-4e30-86f6-ac420c43132b" released by "delete_volume" :: held 0.868s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:51 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Created reservations ['7c1fdbec-1e9d-47e2-af8b-bf31feec4463', 'b7e918dd-08b1-4eee-9070-5caf747c700f', '13f2503d-e627-4a89-8b1b-692401432470', 'b485d076-0e00-44a5-930b-50ea116ea5f0'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:52 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:52 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-e1ad10da-7f85-44f7-a84a-c7952b8eea9c-delete_volume" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-e1ad10da-7f85-44f7-a84a-c7952b8eea9c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "cinder-quobyte-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" by "delete_volume" {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" acquired by "delete_volume" :: waited 0.017s {{(pid=83211) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed5355c-aefe-4195-966e-255231081011]: (4, 'qcow2') {{(pid=84104) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:52 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c Feb 27 02:14:52 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:52 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.401s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:52 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Deleted volume successfully. Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-339ec11e-fa4b-4a7f-866d-6ae367e92e3e tempest-CinderUnicodeTest-221413355 None] Lock "cinder-7932fc06-61e3-4e30-86f6-ac420c43132b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:52 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" returned: 0 in 0.456s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:52 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:52 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c Feb 27 02:14:52 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:53 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51/volume-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" returned: 0 in 0.377s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-quobyte-e1ad10da-7f85-44f7-a84a-c7952b8eea9c" released by "delete_volume" :: held 0.852s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.quota [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Created reservations ['81ceaa52-c673-4979-b8e9-b9a83833891a', 'acec96ba-6b05-45ed-8db6-297386633d37', 'dee9b3a1-6a69-48a1-a82d-3c7ccee56d31', '95b2093f-0fdf-42e6-a6b9-d0e7ea170ac6'] {{(pid=83211) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:14:53 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:14:53 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:14:53 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.424s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:14:53 devstack cinder-volume[83211]: INFO cinder.volume.manager [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Deleted volume successfully. Feb 27 02:14:53 devstack cinder-volume[83211]: DEBUG cinder.coordination [None req-95de462d-aa66-442a-8d24-4ae7cd15dea3 tempest-CinderUnicodeTest-221413355 None] Lock "cinder-e1ad10da-7f85-44f7-a84a-c7952b8eea9c-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=83211) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:14:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:SELECT=202,cinder:UPDATE=262,cinder:INSERT=64,cinder:DELETE=23 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:14:56 devstack cinder-volume[83211]: DEBUG dbcounter [-] [83211] Writing DB stats cinder:UPDATE=323,cinder:SELECT=207,cinder:DELETE=29,cinder:INSERT=78 {{(pid=83211) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_service.periodic_task [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83211) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9': None} {{(pid=83211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG cinder.volume.drivers.quobyte [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d484e9c6-31a1-4d4d-9307-c69fbaba92d9'] {{(pid=83211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.lockutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83211) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:15:13 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51 Feb 27 02:15:13 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:15:13 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG oslo_concurrency.processutils [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1e4345a51d7092f7db605f6c83f2e51" returned: 0 in 0.461s {{(pid=83211) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:15:13 devstack cinder-volume[83211]: DEBUG cinder.manager [None req-0cf523e9-4d66-4948-ac7b-66900924b4f4 None None] Notifying Schedulers of capabilities ... {{(pid=83211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}